-- Logs begin at Fri 2022-10-14 02:17:38 UTC, end at Fri 2022-10-14 03:33:45 UTC. -- Oct 14 02:58:29.847495 dv-cinder-801522-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 14 02:58:29.858035 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 14 02:58:29.860028 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 02:58:29 2022] *** Oct 14 02:58:29.860028 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 02:58:29.860028 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 02:58:29.860028 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: nodename: dv-cinder-801522-13-iscsi Oct 14 02:58:29.860028 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: machine: x86_64 Oct 14 02:58:29.860028 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: clock source: unix Oct 14 02:58:29.860028 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: pcre jit disabled Oct 14 02:58:29.860028 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: detected number of CPU cores: 4 Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: current working directory: / Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: detected binary path: /usr/bin/uwsgi-core Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: your processes number limit is 47680 Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: your memory page size is 4096 bytes Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: detected max file descriptor number: 2048 Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: lock engine: pthread robust mutexes Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: thunder lock: enabled Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 14 02:58:29.860587 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 02:58:29.898977 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: Python main interpreter initialized at 0x55903d6209c0 Oct 14 02:58:29.898977 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: python threads support enabled Oct 14 02:58:29.898977 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: your server socket listen backlog is limited to 100 connections Oct 14 02:58:29.898977 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: your mercy for graceful operations on workers is 90 seconds Oct 14 02:58:29.901313 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 02:58:29.901313 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: *** Operational MODE: preforking *** Oct 14 02:58:29.901313 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: *** uWSGI is running in multiple interpreter mode *** Oct 14 02:58:29.901313 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: spawned uWSGI master process (pid: 104265) Oct 14 02:58:29.901313 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: spawned uWSGI worker 1 (pid: 104266, cores: 1) Oct 14 02:58:29.901313 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: spawned uWSGI worker 2 (pid: 104267, cores: 1) Oct 14 02:58:29.901313 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 02:58:29.899825 dv-cinder-801522-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 14 02:58:30.559059 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 02:58:30.559655 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 02:58:31.638146 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:58:31.638146 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: from cryptography.utils import int_from_bytes Oct 14 02:58:31.638797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:58:31.638797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: from cryptography.utils import int_from_bytes Oct 14 02:58:31.638797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:58:31.638797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: from cryptography.utils import int_from_bytes Oct 14 02:58:31.639322 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:58:31.639322 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: from cryptography.utils import int_from_bytes Oct 14 02:58:34.095966 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 02:58:34.096585 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 02:58:34.096683 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 02:58:34.096683 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 02:58:34.097105 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 02:58:34.097200 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 02:58:34.097294 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 02:58:34.097294 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 02:58:34.097453 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 02:58:34.097583 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 02:58:34.097687 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.097998 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.098154 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.098322 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.098436 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.098639 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.098735 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.098956 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.099050 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.099264 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.099356 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.099574 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.099672 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.099890 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.099981 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.100206 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.100297 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.100463 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.100570 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.100771 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.100864 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.101085 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.101178 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-13-iscsi {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.101399 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.101492 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-13-iscsi {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.101705 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.101832 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.102035 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.102131 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.102343 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.102441 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.102640 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.102733 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.102949 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.103040 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.103249 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.103341 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.103556 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.103742 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.104088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.104399 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.104519 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.104704 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.104929 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.105045 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.105373 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.105463 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.105683 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.105935 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.106126 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.106332 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.106430 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.106637 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.106729 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.106959 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.107095 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.107267 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.107366 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.107598 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.107725 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-13-iscsi {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.108181 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.108295 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.108540 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.108675 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-13-iscsi {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.108851 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.108960 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.109170 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.109265 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.109479 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.109592 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.109867 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.109971 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.110185 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.110278 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.110505 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.110590 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.110809 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.110901 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.111132 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.111219 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.111438 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.111532 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.111752 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.111845 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.112066 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.112152 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.112363 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.112457 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.112674 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.112780 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.112972 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.113064 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.113279 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.113373 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.113578 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.113664 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.113925 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.114032 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.114174 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.114261 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.114480 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.114566 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.114753 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.114850 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.115058 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.115150 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.115375 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.115461 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.115641 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.115739 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.115892 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.116015 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.116208 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.116309 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.116473 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.116554 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.116767 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.116861 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.117083 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.117179 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.117391 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.117478 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.117693 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.117829 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.118028 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.118129 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.118335 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.118443 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.118635 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.118727 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.118937 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.119034 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.119238 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.119329 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.120041 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.120134 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.120365 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.120453 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.120670 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.120761 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.120987 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.121072 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.121293 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.121389 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.121610 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.121698 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.121938 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.122027 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.122258 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.122344 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.122562 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.122649 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.122868 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.122959 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.123186 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.123273 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.123490 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.123581 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.123797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.123888 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.124099 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.124187 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.124402 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.124496 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.124702 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.124796 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.125007 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.125100 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.125317 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.125409 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.125564 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.125658 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.125884 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.126015 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.126190 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.126276 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.126488 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.126596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.126793 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.126880 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.127097 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.127190 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.127400 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.127493 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.127692 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.127786 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.127995 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.128087 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.128291 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.128392 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.128595 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.128687 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.128895 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.128996 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.129195 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.129282 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.129495 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.129581 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.129814 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.129918 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.130119 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.130213 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.130418 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.130504 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.130715 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.130809 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.131013 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.131099 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.131313 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.131409 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.131620 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.131706 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.131922 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.132017 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.132223 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.132316 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.132523 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.132618 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.132823 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.132920 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.133126 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.133213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.133426 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.133512 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.133730 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.133858 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.134056 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.134143 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.134355 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.134443 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.134661 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.134754 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.134960 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.135045 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.135821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.135937 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.136141 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.136232 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.136449 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.136535 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.136766 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.136865 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.137065 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.137210 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.137372 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.137470 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.137686 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.137812 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.138015 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.138102 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.138317 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.138415 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.138622 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.138742 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.138923 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.139030 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.139221 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.139307 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.139519 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.139615 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.139817 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.139910 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.140115 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.140211 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.140413 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.140501 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.140726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.140858 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.141030 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.141159 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.141332 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.141428 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.141634 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.141720 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.141958 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.142046 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.142274 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:58:34.142362 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.142607 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.142695 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.142919 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.143004 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.143250 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.143339 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.143560 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.143656 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.143877 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.144037 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.144186 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.144272 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.144497 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.144591 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.144803 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.144901 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.145113 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.145199 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.145419 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.145513 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.145728 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.145888 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.146067 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.146223 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.146381 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.146493 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.146707 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.146804 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.147021 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.147114 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.147333 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.147420 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.147648 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.147810 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.147964 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.148128 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.148283 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.148447 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.148592 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.148772 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.148920 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.149097 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.149252 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.149407 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.149567 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.149743 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.149898 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.150107 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.150236 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.150421 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.150580 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.150741 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.150935 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.151086 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.151263 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.151395 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.151585 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.151703 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.151895 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.152010 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.152206 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.152348 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.152514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.152661 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.152854 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.153005 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.153166 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.153282 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.153475 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.153593 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.153811 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.153937 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.154127 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.154236 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.154449 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.154537 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.154761 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.154847 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.155070 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.155165 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.155381 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.155475 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.155692 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.155785 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.156001 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.156089 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.156334 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.156429 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.156648 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.156735 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.156956 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.157043 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.157266 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.157352 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.157575 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.157660 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.157908 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.157998 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.158220 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.158318 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.158522 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.158616 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.158824 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.158957 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.159126 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.159214 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.159427 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.159513 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.159725 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.159812 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.160030 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.160116 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.160332 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.160428 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.160638 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.160724 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.160959 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.161098 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.161259 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.161390 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.161565 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.161659 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.161895 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.161996 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.162203 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.162302 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.162506 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.162617 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.162810 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.162895 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.163113 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.163208 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.163413 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.163498 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.163717 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.163809 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.164018 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.164105 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.164320 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.164405 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.164632 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.164718 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.164930 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.165016 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.165233 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.165327 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.165533 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.165627 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.165854 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.165943 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.166167 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.166252 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.166752 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.166867 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.167027 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.167123 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.167203 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.167281 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.167409 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.167512 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.167719 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.167807 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.168050 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.168137 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.168377 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.168473 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.168679 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.168774 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.169000 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.169088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.169314 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.169412 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.169626 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.169711 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.169952 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.170053 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.170258 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.170354 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.170558 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.170644 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.170860 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.170955 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.171159 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.171254 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.171460 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.171546 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.171757 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.171844 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.172056 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.172144 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.172353 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.172445 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.172650 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.172742 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.172948 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.173035 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.173248 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.173344 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.173548 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.173636 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.173877 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.173968 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.174181 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.174266 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.174478 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.174578 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.174782 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.174876 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.175085 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.175172 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.175423 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.175519 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.175725 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.175820 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.176063 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.176150 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.176394 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.176489 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.176709 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.176797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.177027 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.177121 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.177336 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.177432 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.177642 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.177784 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.177972 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.178057 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.178279 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.178366 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.178587 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.178673 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.178893 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.178979 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.179210 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.179342 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.179514 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.179601 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.179829 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.179914 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.180135 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.180222 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.180451 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.180537 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.180751 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.180844 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.181061 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.181149 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.181360 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.181462 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.181668 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.181918 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.182527 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.182625 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.182852 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.182940 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.183166 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.183262 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.183486 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.183572 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.183792 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.183878 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.184098 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.184196 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.184401 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.184487 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.184708 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.184793 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.185013 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.185108 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.185318 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.185410 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.185632 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.185717 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.185960 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.186059 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.186275 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.186360 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.186580 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.186665 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.186896 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.186983 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.187197 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.187283 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.187507 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.187600 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.187806 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.187892 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.188115 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.188208 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.188434 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.188519 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.188742 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.188830 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.189051 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.189137 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.189357 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.189443 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.189662 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.189750 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.189990 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.190087 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.190291 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.190384 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.190591 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.190678 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.190890 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.190975 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.191192 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.191292 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.191496 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.191588 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.191802 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.191893 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.192102 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.192199 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.192406 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.192492 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.192705 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.192792 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.193003 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.193096 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.193304 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.193400 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.193602 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.193688 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.193925 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.194025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.194237 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.194331 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.194554 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.194639 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.194861 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.194955 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.195160 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.195247 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.195462 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.195549 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.195769 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.195857 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.196068 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.196156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.196369 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.196454 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.196672 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.196760 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.196973 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.197066 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.197276 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.197362 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.197576 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.197703 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.198460 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.198549 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.198776 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.198872 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.199093 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.199188 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.199397 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.199531 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.199707 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.199803 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.200012 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.200099 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.200317 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.200404 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.200622 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.200720 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.200932 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.201018 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.201234 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.201327 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.201542 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.201637 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.201867 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.201957 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.202175 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.202271 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.202483 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.202569 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.202793 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.202880 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.203096 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.203190 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.203404 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.203492 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.203707 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.203792 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.204006 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.204091 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.204312 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.204405 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.204612 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.204698 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.204919 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.205173 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.205272 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.205504 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.205788 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.205889 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.206122 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.206217 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.206437 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.206531 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.206753 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.206854 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.207092 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.207178 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.207409 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.207508 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.207718 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.207805 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.208019 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.208113 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.208325 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.208413 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.208628 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.208717 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.208929 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.209023 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.209233 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.209328 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.209533 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.209653 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.209858 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.209950 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.210161 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.210269 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.210463 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.210550 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.210761 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.210848 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.211062 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.211158 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.211358 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.211443 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.211654 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.211748 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.211952 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.212046 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.212249 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.212335 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.212555 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.212640 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.212854 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.212949 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.213159 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.213246 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.213482 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.213578 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.213806 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.213897 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.214107 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.214194 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.214408 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.214506 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.214709 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.214797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.215010 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.215097 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.215349 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.215436 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.215650 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.215744 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.215988 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.216076 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.216288 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.216383 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.216590 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.216677 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.216910 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.216998 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.217211 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.217312 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.217512 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.217599 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.217831 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.217925 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.218133 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.218229 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.218432 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.218519 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.218727 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.218812 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.219030 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.219123 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.219334 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.219421 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.219637 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.219756 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.219939 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.220035 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.220236 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.220323 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.220538 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.220624 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.220835 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.220930 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.221137 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.221225 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.221436 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.221524 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.221732 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.221868 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.222052 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.222139 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.222348 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.222434 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.222647 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.222735 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.222942 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.223033 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.223244 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.223340 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.223543 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.223630 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.223848 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.223941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.224143 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.224238 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.224443 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.224529 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.224740 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.224833 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.225041 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.225136 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.225342 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.225430 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.225638 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.225723 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.225965 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.226060 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.226264 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.226352 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.226562 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.226648 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.226861 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.226955 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.227163 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.227257 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.227461 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.227555 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.227760 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.227855 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.228058 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.228144 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.228357 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.228445 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.228663 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.228751 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.228984 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.229086 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.229291 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.229385 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.229591 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.229679 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.229918 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.230017 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.230217 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.230312 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.230520 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.230606 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.230814 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.230907 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.231112 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.231208 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.231408 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.231494 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.231704 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.231836 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.232002 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.232096 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.232301 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.232396 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.232599 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.232686 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.233161 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.233262 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.233505 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.233597 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.233834 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.233925 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.234141 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.234230 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.234441 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.234528 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.234779 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.234867 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.235080 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.235176 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.235388 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.235481 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.235705 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.235792 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.236014 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.236103 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.236324 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.236411 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.236631 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.236716 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.236932 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.237020 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.237240 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.237364 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.237551 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.237685 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.237877 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.238000 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.238181 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.238272 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.238482 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.238583 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.238782 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.238868 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.239083 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.239178 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.239394 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.239494 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.239706 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.239791 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.240020 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.240121 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.240335 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.240435 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.240637 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.240725 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.240943 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.241030 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.241245 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.241339 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.241550 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.241635 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.241878 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.241979 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.242187 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.242276 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.242493 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.242589 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.242800 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.242894 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.243110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.243199 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.243420 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.243508 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.243731 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.243818 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.244032 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.244120 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.244338 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.244423 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.245154 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.245251 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.245455 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.245550 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.245786 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.245875 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.246085 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.246184 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.246386 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.246480 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.246693 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.246780 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.246994 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.247089 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.247302 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.247387 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.247603 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.247697 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.247914 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.248010 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.248216 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.248303 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.248615 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.248702 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.248921 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.249018 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.249229 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.249317 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.249533 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.249620 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.249873 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.249973 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.250182 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.250272 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.250481 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.250568 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.250798 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.250885 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.251100 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.251187 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.251486 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.251572 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.251796 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.251898 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.252099 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.252198 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.252401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.252496 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.252703 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.252854 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.253006 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.253177 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.253315 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.253485 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.253637 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.253808 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.253960 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.254119 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.254262 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.254440 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.254565 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.254821 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.254908 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.255147 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.255235 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.255478 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.255565 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.255854 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.255948 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.256158 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.256254 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.256472 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.256558 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.256863 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.256949 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.257171 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.257272 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.257478 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.257577 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.257819 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.257909 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.258145 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.258246 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.258445 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.258540 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.258801 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.258895 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.259063 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.259158 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.259369 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.259529 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.259689 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.259776 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.260000 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.260100 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.260851 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.260953 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.261155 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.261241 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.261461 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.261548 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.261803 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.261913 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.262118 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.262205 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.262430 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.262523 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.262751 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.262839 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.263150 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.263237 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.263464 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.263551 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.263772 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.263858 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.264090 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.264177 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.264392 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.264478 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.264695 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.264783 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.264994 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.265080 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.265297 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.265397 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.265600 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.265685 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.265927 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.266016 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.266238 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.266337 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.266542 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.266628 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.266850 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.266935 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.267159 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.267254 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.267463 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.267556 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.267762 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.267848 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.268063 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.268158 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.268373 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.268459 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.268672 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.268758 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.268991 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.269078 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.269299 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.269384 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.269622 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.269709 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.269948 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.270094 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.270255 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.270341 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.270562 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.270648 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.270865 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.270961 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.271167 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.271253 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.271468 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.271554 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.271768 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.271856 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.272099 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.272229 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.272401 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.272496 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.272719 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.272807 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.273041 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.273128 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.273348 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.273444 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.273660 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.273747 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.274032 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.274130 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.274358 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.274458 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.274678 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.274765 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.274985 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.275073 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.275299 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.275394 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.275621 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.275716 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.275946 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.276035 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.276247 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.276336 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.276553 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.276640 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.276855 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.276950 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.277157 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.277252 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.277455 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.277542 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.277751 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.277940 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.278071 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.278159 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.278370 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.278456 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.278669 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.278756 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.278978 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.279066 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.279278 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.279364 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.279588 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.279682 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.279890 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.279979 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.280190 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.280284 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.280489 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.280583 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.280788 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.280881 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.281113 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.281200 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.281414 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.281515 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.281732 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.281884 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.282059 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.282148 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.282373 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.282468 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.282683 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.282769 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.282994 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.283082 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.283307 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.283394 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.283618 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.283706 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.283929 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.284015 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.284242 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.284336 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.284545 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.284638 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.284849 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.284935 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.285159 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.285247 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.285470 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.285555 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.285807 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.286003 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.286320 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.286409 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.286629 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.286716 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.286939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.287036 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.287248 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.287335 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.287555 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.287641 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.287861 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.287955 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.288167 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.288262 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.288473 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.288567 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.288780 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.288941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.289084 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.289178 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.289393 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.289481 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.289713 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.289826 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.290055 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.290150 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.290380 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.290468 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.290692 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.290780 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.291005 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.291092 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.291317 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.291423 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.291655 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.291743 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.291968 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.292053 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.292306 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.292440 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.292607 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.292696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.292912 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.292998 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.293220 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.293307 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.293529 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.293615 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.293861 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.293952 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.294172 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.294268 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.294482 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.294576 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.294791 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.294879 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.295100 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.295188 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.295404 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.295534 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.295709 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.295797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.296017 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.296105 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.296326 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.296412 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.296647 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.296745 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.296961 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.297048 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.297273 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.297361 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.297583 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.297677 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.297918 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.298007 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.298231 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.298430 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.298739 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.298834 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.299048 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.299134 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.299374 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.299461 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.299694 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.299782 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.300005 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.300093 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.300313 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.300442 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.300627 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.300722 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.300927 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.301014 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.301227 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.301322 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.301526 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.301614 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.301852 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.301945 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.302153 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.302240 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.302453 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.302542 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.302766 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.302851 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.303067 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.303162 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.303367 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.303453 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.303671 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.303764 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.303972 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.304205 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.304501 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.304588 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.304843 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.304936 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.305159 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.305254 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.305476 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.305611 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.305807 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.305899 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.306116 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.306217 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.306421 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.306507 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.306727 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.306813 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.307543 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.307640 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.307853 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.307939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.308159 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.308247 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.308458 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.308546 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.308758 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.308844 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.309061 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.309148 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.309363 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.309450 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.309661 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.309845 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.309983 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.310070 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.310284 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.310379 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.310585 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.310675 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.310899 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.310998 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.311200 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.311287 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.311501 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.311588 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.311802 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.311903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.312100 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.312188 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.312400 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.312488 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.312699 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.312797 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.312997 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.313085 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.313297 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.313389 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.313595 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.313691 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.313916 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.314004 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.314226 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.314313 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.314533 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.314622 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.314848 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.314936 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.315172 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.315266 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.315471 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.315561 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.315780 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.315869 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.316077 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.316164 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.316376 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.316472 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.316674 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.316760 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.316986 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.317072 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.317293 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.317387 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.317599 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.317693 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.317931 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.318099 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.318245 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.318340 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.318572 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.318659 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.318891 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.319104 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.319420 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.319509 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.319750 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.319837 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.320071 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.320166 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.320402 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.320490 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.320707 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.320797 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.321017 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.321114 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.321321 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.321407 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.321627 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.321715 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.321965 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.322055 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.322274 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.322361 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.322582 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.322687 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.323438 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.323538 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.323750 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.323837 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.324056 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.324142 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.324363 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.324450 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.324667 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.324754 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.324973 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.325073 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.325278 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.325364 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.325583 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.325671 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.325908 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.326010 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.326215 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.326310 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.326522 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.326647 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.326825 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.327135 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.327227 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.327475 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.327562 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.327793 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.327889 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.328107 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.328194 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.328418 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.328506 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.328734 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.328832 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.329040 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.329127 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.329346 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.329433 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.329652 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.329747 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.329979 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.330066 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.330294 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.330394 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.330619 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.330760 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.330927 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.331015 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.331228 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.331322 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.331881 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.331969 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.332195 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.332288 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.332514 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.332601 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.332835 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.332923 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.333145 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.333231 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.333464 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.333559 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.333801 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.333907 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.334117 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.334205 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.334434 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.334530 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.334743 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.334839 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.335069 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.335163 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.335404 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.335499 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.335728 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.335814 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.336048 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.336134 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.336347 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.336442 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.336648 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.336735 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.336947 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.337035 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.337252 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.337339 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.337566 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.337652 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.337891 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.337980 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.338193 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.338301 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.338517 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.338610 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.338822 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.338917 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.339122 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.339209 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.339424 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.339510 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.339724 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.339823 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.340024 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.340110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.340329 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.340417 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.340627 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.340721 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.340926 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.341013 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.341222 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.341308 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.341521 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.341615 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.341837 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.341927 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.342139 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.342225 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.342444 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.342543 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.342744 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.342831 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.343045 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.343134 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.343344 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.343432 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.343643 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.343729 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.343940 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.344034 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.344267 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.344354 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.344594 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.344681 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.344903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.344990 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.345221 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.345308 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.345530 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.345616 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.345869 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.345995 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.346178 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.346266 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.346495 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.346581 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.346812 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.346912 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.347124 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.347210 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.347431 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.347517 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.347755 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.347916 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.348060 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.348147 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.348367 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.348453 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.348674 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.348774 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.348982 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.349069 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.349285 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.349372 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.349590 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.349685 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.349937 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.350028 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.350262 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.350353 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.350563 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.350651 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.350883 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.350970 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.351197 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.351285 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.351514 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.351602 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.351824 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.351910 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.352132 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.352218 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.352457 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.352551 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.352766 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.352889 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.353074 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.353186 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.353379 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.353465 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.353686 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.353791 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.354537 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.354641 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.354851 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.354938 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.355162 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.355248 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.355471 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.355567 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.355784 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.355871 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.356096 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.356182 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.356418 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.356505 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.356737 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.356823 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.357043 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.357129 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.357362 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.357459 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.357683 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.358081 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.358314 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.358412 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.358626 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.358714 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.358966 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.359053 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.359293 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.359387 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.359602 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.359689 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.359911 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.359997 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.360211 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.360310 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:58:34.360450 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 02:58:34.360537 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 02:58:34.512529 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO dbcounter [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Registered counter for database nova_api Oct 14 02:58:34.512726 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO dbcounter [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Registered counter for database nova_api Oct 14 02:58:34.533145 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_db.sqlalchemy.engines [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:34.536669 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_db.sqlalchemy.engines [None req-0889fc19-0545-4765-a540-9575710e1836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:34.539575 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writer thread running {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:34.543677 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writer thread running {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:34.595316 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.context [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dccde63-09d3-408b-8840-86bc0620ec2d(cell1) {{(pid=104267) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 02:58:34.598752 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.context [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dccde63-09d3-408b-8840-86bc0620ec2d(cell1) {{(pid=104266) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 02:58:34.599238 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 02:58:34.599702 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 02:58:34.601247 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 02:58:34.601986 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 02:58:34.602425 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 02:58:34.602644 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_concurrency.lockutils [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 02:58:34.603115 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_concurrency.lockutils [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 02:58:34.604898 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 02:58:34.605167 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_concurrency.lockutils [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 02:58:34.605916 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_concurrency.lockutils [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 02:58:34.606356 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_concurrency.lockutils [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 02:58:34.606883 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO dbcounter [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Registered counter for database nova_cell0 Oct 14 02:58:34.608580 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_concurrency.lockutils [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104266) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 02:58:34.610592 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO dbcounter [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Registered counter for database nova_cell0 Oct 14 02:58:34.611089 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO dbcounter [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Registered counter for database nova_cell1 Oct 14 02:58:34.614603 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO dbcounter [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Registered counter for database nova_cell1 Oct 14 02:58:34.618343 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_db.sqlalchemy.engines [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:34.621069 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_db.sqlalchemy.engines [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:34.622683 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_db.sqlalchemy.engines [None req-0889fc19-0545-4765-a540-9575710e1836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:34.625008 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_db.sqlalchemy.engines [None req-0889fc19-0545-4765-a540-9575710e1836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:34.625645 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writer thread running {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:34.630023 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writer thread running {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:34.635271 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writer thread running {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:34.760831 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writer thread running {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:34.770619 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO dbcounter [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Registered counter for database nova_cell0 Oct 14 02:58:34.775658 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO dbcounter [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Registered counter for database nova_cell0 Oct 14 02:58:34.779917 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_db.sqlalchemy.engines [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:34.784728 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG oslo_db.sqlalchemy.engines [None req-0889fc19-0545-4765-a540-9575710e1836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:58:34.784866 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writer thread running {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:34.789375 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writer thread running {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:58:35.190776 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: WARNING keystonemiddleware.auth_token [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 02:58:35.198678 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: WARNING keystonemiddleware.auth_token [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 02:58:35.218086 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: WARNING keystonemiddleware.auth_token [None req-0889fc19-0545-4765-a540-9575710e1836 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 02:58:35.225367 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: WARNING keystonemiddleware.auth_token [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 02:58:35.539657 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: WARNING keystonemiddleware.auth_token [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 02:58:35.545568 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: WARNING keystonemiddleware.auth_token [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 02:58:35.551162 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55903d6209c0 pid: 104267 (default app) Oct 14 02:58:35.553212 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 02:58:35.554420 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Oct 14 02:58:35.554820 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Fri Oct 14 02:58:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 02:58:35.564017 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: WARNING keystonemiddleware.auth_token [None req-0889fc19-0545-4765-a540-9575710e1836 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 02:58:35.569963 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: WARNING keystonemiddleware.auth_token [None req-0889fc19-0545-4765-a540-9575710e1836 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 02:58:35.575761 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55903d6209c0 pid: 104266 (default app) Oct 14 02:59:58.893249 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 02:59:58.894557 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001874 Oct 14 02:59:58.895345 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 02:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 02:59:58.913035 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writing DB stats nova_api:SELECT=3 {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:58.914793 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writing DB stats nova_cell1:SELECT=3 {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:58.915979 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writing DB stats nova_cell0:SELECT=3 {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:58.916980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:59.773855 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-66a5dae5-0c6f-4c12-b7a5-b49faf21889a admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 02:59:59.806875 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-66a5dae5-0c6f-4c12-b7a5-b49faf21889a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904130 Oct 14 02:59:59.807630 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1292 bytes} [Fri Oct 14 02:59:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:02.411775 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:02.412778 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-a0bf32f1-2160-4464-bc2f-cf8213eab383 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 14 03:00:02.413359 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:02.864636 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-c7459a47-5abf-4cb5-8d2f-183a16b058f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:02.965135 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-c7459a47-5abf-4cb5-8d2f-183a16b058f9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.545107 Oct 14 03:00:02.965621 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:02.979956 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_api:SELECT=3 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:02.981070 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_cell0:SELECT=3 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:02.983282 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_cell1:SELECT=3 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:02.984289 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:03.193558 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-f2cc8697-460b-4b0c-aab0-70060aaaf75c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:03.311348 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-f2cc8697-460b-4b0c-aab0-70060aaaf75c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.337320 Oct 14 03:00:03.312248 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Oct 14 03:00:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:05.927434 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-c7459a47-5abf-4cb5-8d2f-183a16b058f9 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:05.928458 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-c7459a47-5abf-4cb5-8d2f-183a16b058f9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 14 03:00:05.928867 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:06.567957 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a2660fd1-d171-4ee3-90d6-ed2a39fcd3e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "id": "d1"}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:06.684858 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-a2660fd1-d171-4ee3-90d6-ed2a39fcd3e1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.748925 Oct 14 03:00:06.692591 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:06.698278 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-b1c05675-3fd7-4746-8af6-6f020922092c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:06.812197 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-b1c05675-3fd7-4746-8af6-6f020922092c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118024 Oct 14 03:00:06.813078 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Oct 14 03:00:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:09.380120 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a2660fd1-d171-4ee3-90d6-ed2a39fcd3e1 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:09.381163 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-a2660fd1-d171-4ee3-90d6-ed2a39fcd3e1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 14 03:00:09.381591 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:09.800147 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-12e600da-8751-4ce8-bf92-7c4dd169132d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "id": "d2", "name": "ds1G", "disk": 10}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:09.875410 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-12e600da-8751-4ce8-bf92-7c4dd169132d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487311 Oct 14 03:00:09.876174 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:09.888576 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-0da811d5-43e1-4d2e-9371-ca1beb2535b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:09.955024 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-0da811d5-43e1-4d2e-9371-ca1beb2535b5 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070235 Oct 14 03:00:09.955622 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Oct 14 03:00:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:12.556450 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-12e600da-8751-4ce8-bf92-7c4dd169132d admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:12.558051 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-12e600da-8751-4ce8-bf92-7c4dd169132d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Oct 14 03:00:12.558457 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:12.966789 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-bcf26ce3-48d5-4bd5-93d0-660e9f92d38e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "id": "d3"}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:13.053121 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-bcf26ce3-48d5-4bd5-93d0-660e9f92d38e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488555 Oct 14 03:00:13.053716 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:13.065963 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-54390efc-3f94-4ced-99b4-1d4f4f2b87db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:13.154033 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-54390efc-3f94-4ced-99b4-1d4f4f2b87db admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091455 Oct 14 03:00:13.154545 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Oct 14 03:00:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:00:15.759051 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-bcf26ce3-48d5-4bd5-93d0-660e9f92d38e admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:15.760056 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-bcf26ce3-48d5-4bd5-93d0-660e9f92d38e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Oct 14 03:00:15.760483 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:16.183262 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-786a30e0-5481-4a75-8aad-3ab3e51b3e9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:16.272245 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-786a30e0-5481-4a75-8aad-3ab3e51b3e9c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505213 Oct 14 03:00:16.273511 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:00:16.285883 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-49e149cd-2f64-4ebf-a13f-086e155768d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:16.365739 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-49e149cd-2f64-4ebf-a13f-086e155768d3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083504 Oct 14 03:00:16.366946 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1336 bytes} [Fri Oct 14 03:00:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:19.570252 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-786a30e0-5481-4a75-8aad-3ab3e51b3e9c admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:19.571538 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-786a30e0-5481-4a75-8aad-3ab3e51b3e9c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002603 Oct 14 03:00:19.572082 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:19.999455 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-fdc13935-4784-4c97-a324-86dcc3507807 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:20.025033 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-fdc13935-4784-4c97-a324-86dcc3507807 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446819 Oct 14 03:00:20.025578 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1292 bytes} [Fri Oct 14 03:00:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:22.679234 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-786a30e0-5481-4a75-8aad-3ab3e51b3e9c admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:22.680332 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-786a30e0-5481-4a75-8aad-3ab3e51b3e9c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002201 Oct 14 03:00:22.680738 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:23.080563 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-adb4da6e-fad8-4d18-8dc5-605d25029f0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "disk": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:23.150680 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-adb4da6e-fad8-4d18-8dc5-605d25029f0a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.463731 Oct 14 03:00:23.151266 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:23.163876 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-e8ffcd4c-caca-402f-85d9-5fd5c81a4c1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:23.245336 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-e8ffcd4c-caca-402f-85d9-5fd5c81a4c1e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085468 Oct 14 03:00:23.245984 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:25.808944 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-adb4da6e-fad8-4d18-8dc5-605d25029f0a admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:25.809996 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-adb4da6e-fad8-4d18-8dc5-605d25029f0a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 14 03:00:25.810420 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:26.182824 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-fdd0b594-ae97-4bc9-b8d1-67bd8a8acb03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "disk": 20}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:26.248136 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-fdd0b594-ae97-4bc9-b8d1-67bd8a8acb03 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.431645 Oct 14 03:00:26.249346 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:00:26.261805 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-5a288f05-4d29-4337-9f87-ad53a7b9d411 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:26.332041 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-5a288f05-4d29-4337-9f87-ad53a7b9d411 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073767 Oct 14 03:00:26.332727 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:28.973409 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-fdd0b594-ae97-4bc9-b8d1-67bd8a8acb03 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:28.976176 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-fdd0b594-ae97-4bc9-b8d1-67bd8a8acb03 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 14 03:00:28.976176 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:29.409941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-e6f3a16b-e89d-4de6-9e60-82b648d360a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:29.497564 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-e6f3a16b-e89d-4de6-9e60-82b648d360a3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.515495 Oct 14 03:00:29.498422 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:00:29.511340 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-32495123-6c83-4da4-a8ea-06e28353fd6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:29.516355 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:29.592276 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-32495123-6c83-4da4-a8ea-06e28353fd6a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084450 Oct 14 03:00:29.597806 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:00:32.197311 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-e6f3a16b-e89d-4de6-9e60-82b648d360a3 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:32.198962 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-e6f3a16b-e89d-4de6-9e60-82b648d360a3 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002097 Oct 14 03:00:32.199559 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:32.622288 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-bd1562a5-01a7-4e79-bcc1-bb3f3efdc69d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "ram": 8192}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:32.697261 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-bd1562a5-01a7-4e79-bcc1-bb3f3efdc69d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491701 Oct 14 03:00:32.698029 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:32.710207 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-aa4476ba-a4b9-4265-a7cf-0779a2df3852 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:32.786670 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-aa4476ba-a4b9-4265-a7cf-0779a2df3852 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080433 Oct 14 03:00:32.787331 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:35.486492 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-bd1562a5-01a7-4e79-bcc1-bb3f3efdc69d admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:35.487417 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-bd1562a5-01a7-4e79-bcc1-bb3f3efdc69d admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 14 03:00:35.493465 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:35.918963 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-6d64c31e-2ec8-4b1c-90ba-3dc41269ce04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "id": "5", "disk": 160, "swap": 0}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:35.995098 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_api:SELECT=46,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:36.012840 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-6d64c31e-2ec8-4b1c-90ba-3dc41269ce04 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.517848 Oct 14 03:00:36.020803 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1283 bytes} [Fri Oct 14 03:00:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:00:36.025794 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-2a8b5ab9-9473-4e03-8a5f-8682928e5c1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:00:36.108062 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-2a8b5ab9-9473-4e03-8a5f-8682928e5c1b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086149 Oct 14 03:00:36.109222 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1333 bytes} [Fri Oct 14 03:00:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:00:53.049060 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-6d64c31e-2ec8-4b1c-90ba-3dc41269ce04 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:53.050120 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-6d64c31e-2ec8-4b1c-90ba-3dc41269ce04 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 14 03:00:53.050521 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:00:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:53.061679 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:53.434625 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-25decde6-702a-4282-bd81-242c6e5a4b03 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:53.452181 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-25decde6-702a-4282-bd81-242c6e5a4b03 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395044 Oct 14 03:00:53.452718 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1292 bytes} [Fri Oct 14 03:00:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:54.755405 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-6d64c31e-2ec8-4b1c-90ba-3dc41269ce04 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:54.756458 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-6d64c31e-2ec8-4b1c-90ba-3dc41269ce04 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 14 03:00:54.756868 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:55.275812 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-7a51ca45-0506-4757-a6a2-e051a67df919 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:55.281150 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.wsgi [None req-7a51ca45-0506-4757-a6a2-e051a67df919 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-7a51ca45-0506-4757-a6a2-e051a67df919 admin admin] Request method failure captured: Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Accept: application/json Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Accept-Encoding: gzip, deflate Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Connection: keep-alive Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Content-Length: 0 Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Host: 10.222.0.39 Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Openstack-System-Scope: None Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: User-Agent: python-novaclient Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Auth-Token: gAAAAABjSNDm_d0m4LxRpCMxztZy2nRYPlF8pRQ7s3MzfmN7k2k-ki5BEmRcj_ZVnrisxdwati2Yp-TA9yqmNA5DSDZ1SR1zBGtV3mlpFjn4Vd5hcE0qpwcbKEFQYXZIhbsrzu6PEKg2CLMZG_HJKJ8oO533xFTuyf-qb0G9NDAwwfQSKof3hkY Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Domain-Id: None Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Domain-Name: None Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Identity-Status: Confirmed Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Is-Admin-Project: True Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Domain-Id: default Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Domain-Name: Default Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Name: admin Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Role: member,reader,admin Oct 14 03:00:55.284352 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Roles: member,reader,admin Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e86df8ec1d224299a71e492e2b3fb74d"}]}] Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant: admin Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant-Name: admin Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User: admin Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Domain-Id: default Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Domain-Name: Default Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Id: 316b39adbf9f4b0d9c13dc4c11a24e73 Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Name: admin Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: method: > Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: exception: Flavor 42 could not be found. Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: action_args: {'id': '42'} Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:55.286110 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:55.286980 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.288696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-7a51ca45-0506-4757-a6a2-e051a67df919 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:55.289962 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-7a51ca45-0506-4757-a6a2-e051a67df919 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391064 Oct 14 03:00:55.289962 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Fri Oct 14 03:00:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:55.296632 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-18f506ee-be50-414c-b81e-ad01db6718c2 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:55.318080 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-18f506ee-be50-414c-b81e-ad01db6718c2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025431 Oct 14 03:00:55.318611 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:55.329855 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-694208c2-92bc-41f7-a465-89175282ae79 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:55.352460 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-694208c2-92bc-41f7-a465-89175282ae79 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027200 Oct 14 03:00:55.353007 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:55.362689 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-174583f5-6f9a-465c-ad6c-9a91cce379ca admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:55.368166 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.wsgi [None req-174583f5-6f9a-465c-ad6c-9a91cce379ca admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-174583f5-6f9a-465c-ad6c-9a91cce379ca admin admin] Request method failure captured: Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Accept: application/json Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Accept-Encoding: gzip, deflate Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Connection: keep-alive Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Content-Length: 0 Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Host: 10.222.0.39 Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Openstack-System-Scope: None Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: User-Agent: python-novaclient Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Auth-Token: gAAAAABjSNDm_d0m4LxRpCMxztZy2nRYPlF8pRQ7s3MzfmN7k2k-ki5BEmRcj_ZVnrisxdwati2Yp-TA9yqmNA5DSDZ1SR1zBGtV3mlpFjn4Vd5hcE0qpwcbKEFQYXZIhbsrzu6PEKg2CLMZG_HJKJ8oO533xFTuyf-qb0G9NDAwwfQSKof3hkY Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Domain-Id: None Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Domain-Name: None Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Identity-Status: Confirmed Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Is-Admin-Project: True Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Domain-Id: default Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Domain-Name: Default Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Name: admin Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Role: member,reader,admin Oct 14 03:00:55.371449 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Roles: member,reader,admin Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e86df8ec1d224299a71e492e2b3fb74d"}]}] Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant: admin Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant-Name: admin Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User: admin Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Domain-Id: default Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Domain-Name: Default Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Id: 316b39adbf9f4b0d9c13dc4c11a24e73 Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Name: admin Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: method: > Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: exception: Flavor 42 could not be found. Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: action_args: {'id': '42'} Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:55.378088 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:55.378903 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:55.380156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-174583f5-6f9a-465c-ad6c-9a91cce379ca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:55.381383 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-174583f5-6f9a-465c-ad6c-9a91cce379ca admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014243 Oct 14 03:00:55.381383 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Fri Oct 14 03:00:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:56.574884 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-694208c2-92bc-41f7-a465-89175282ae79 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:56.575894 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-694208c2-92bc-41f7-a465-89175282ae79 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 14 03:00:56.576294 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:57.096464 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-38d54a78-45d7-4b3a-a7ff-7a357d8d7c07 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:57.101399 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.wsgi [None req-38d54a78-45d7-4b3a-a7ff-7a357d8d7c07 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-38d54a78-45d7-4b3a-a7ff-7a357d8d7c07 admin admin] Request method failure captured: Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Accept: application/json Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Accept-Encoding: gzip, deflate Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Connection: keep-alive Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Content-Length: 0 Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Host: 10.222.0.39 Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Openstack-System-Scope: None Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: User-Agent: python-novaclient Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Auth-Token: gAAAAABjSNDoKnyiAR74syYxiVCte_yqlQbAjqaZPQE3rAkr__oCRkULgzPk-pftHRP5PIhCYbAS1NtIrpxFnKqQTn7f36_K7ZFn4ckOxPvKFW2V1j-y8_fVl573KZd6CcXO3ajI9DPJGr1Z3_J1dSp6ZeJxIv5tn7WuuepFVG5IHF07nT_p2CU Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Domain-Id: None Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Domain-Name: None Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Identity-Status: Confirmed Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Is-Admin-Project: True Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Domain-Id: default Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Domain-Name: Default Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Name: admin Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Role: member,reader,admin Oct 14 03:00:57.102941 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Roles: member,reader,admin Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e86df8ec1d224299a71e492e2b3fb74d"}]}] Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant: admin Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant-Name: admin Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User: admin Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Domain-Id: default Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Domain-Name: Default Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Id: 316b39adbf9f4b0d9c13dc4c11a24e73 Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Name: admin Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: method: > Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: exception: Flavor 84 could not be found. Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: action_args: {'id': '84'} Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:57.104456 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:57.105401 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.106726 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-38d54a78-45d7-4b3a-a7ff-7a357d8d7c07 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:57.107987 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-38d54a78-45d7-4b3a-a7ff-7a357d8d7c07 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391238 Oct 14 03:00:57.107987 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Fri Oct 14 03:00:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:57.114214 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-e8dfa269-1c80-4838-a8ba-76403a54b493 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:57.128637 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-e8dfa269-1c80-4838-a8ba-76403a54b493 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017963 Oct 14 03:00:57.129152 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:57.138660 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a6015495-9b8d-423a-9cba-9b63fc398e6a admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:57.154527 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-a6015495-9b8d-423a-9cba-9b63fc398e6a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019319 Oct 14 03:00:57.155043 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:57.163985 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-503fc2c1-c861-45e7-9d68-6f7ca96b7462 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:57.168854 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.wsgi [None req-503fc2c1-c861-45e7-9d68-6f7ca96b7462 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-503fc2c1-c861-45e7-9d68-6f7ca96b7462 admin admin] Request method failure captured: Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Accept: application/json Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Accept-Encoding: gzip, deflate Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Connection: keep-alive Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Content-Length: 0 Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Host: 10.222.0.39 Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Openstack-System-Scope: None Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: User-Agent: python-novaclient Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Auth-Token: gAAAAABjSNDoKnyiAR74syYxiVCte_yqlQbAjqaZPQE3rAkr__oCRkULgzPk-pftHRP5PIhCYbAS1NtIrpxFnKqQTn7f36_K7ZFn4ckOxPvKFW2V1j-y8_fVl573KZd6CcXO3ajI9DPJGr1Z3_J1dSp6ZeJxIv5tn7WuuepFVG5IHF07nT_p2CU Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Domain-Id: None Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Domain-Name: None Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Identity-Status: Confirmed Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Is-Admin-Project: True Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Domain-Id: default Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Domain-Name: Default Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Name: admin Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Role: member,reader,admin Oct 14 03:00:57.170403 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Roles: member,reader,admin Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e86df8ec1d224299a71e492e2b3fb74d"}]}] Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant: admin Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant-Name: admin Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User: admin Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Domain-Id: default Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Domain-Name: Default Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Id: 316b39adbf9f4b0d9c13dc4c11a24e73 Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Name: admin Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: method: > Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: exception: Flavor 84 could not be found. Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: action_args: {'id': '84'} Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:57.171737 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:57.172532 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:57.173564 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-503fc2c1-c861-45e7-9d68-6f7ca96b7462 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:57.174589 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-503fc2c1-c861-45e7-9d68-6f7ca96b7462 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011317 Oct 14 03:00:57.174589 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Fri Oct 14 03:00:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 14 03:00:58.376156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a6015495-9b8d-423a-9cba-9b63fc398e6a admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:58.377164 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-a6015495-9b8d-423a-9cba-9b63fc398e6a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 14 03:00:58.377560 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:00:58.893035 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-e90b4e19-3ca7-437b-8a0e-8929deb34f1d admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:58.899005 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.wsgi [None req-e90b4e19-3ca7-437b-8a0e-8929deb34f1d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-e90b4e19-3ca7-437b-8a0e-8929deb34f1d admin admin] Request method failure captured: Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Accept: application/json Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Accept-Encoding: gzip, deflate Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Connection: keep-alive Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Content-Length: 0 Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Host: 10.222.0.39 Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Openstack-System-Scope: None Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: User-Agent: python-novaclient Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Auth-Token: gAAAAABjSNDq8vcOH2E4Opkr1clnly05w9jRqC7vR7dnLg4UqgWWpl4-1kfbsoJ7PsbWI8d307bXFIoS69EDTfpC665i4aOSPi90ReI9nCxA-2oPV4saArOIfxZnSe7S1K50Vh1tihiqzX6s-IZbNl9FiXNmg9lKlvrr8XuM0L2MVjuL16rP3Sw Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Domain-Id: None Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Domain-Name: None Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Identity-Status: Confirmed Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Is-Admin-Project: True Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Domain-Id: default Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Domain-Name: Default Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Project-Name: admin Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Role: member,reader,admin Oct 14 03:00:58.900514 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Roles: member,reader,admin Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e86df8ec1d224299a71e492e2b3fb74d"}]}] Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant: admin Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-Tenant-Name: admin Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User: admin Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Domain-Id: default Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Domain-Name: Default Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Id: 316b39adbf9f4b0d9c13dc4c11a24e73 Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: X-User-Name: admin Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: method: > Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: exception: Flavor 451 could not be found. Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: action_args: {'id': '451'} Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:58.902088 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:58.906821 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.908108 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-e90b4e19-3ca7-437b-8a0e-8929deb34f1d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104266) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:58.909415 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-e90b4e19-3ca7-437b-8a0e-8929deb34f1d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385055 Oct 14 03:00:58.909415 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Oct 14 03:00:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:58.911555 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-8490c9d5-b558-4f7a-a161-0d7bf9350c45 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:58.926361 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-8490c9d5-b558-4f7a-a161-0d7bf9350c45 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018370 Oct 14 03:00:58.926887 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:00:58.936817 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:58.951939 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018644 Oct 14 03:00:58.952461 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Fri Oct 14 03:00:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:00:58.961460 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a7523db0-e9e8-42aa-879e-1d505f529e88 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:00:58.966425 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.wsgi [None req-a7523db0-e9e8-42aa-879e-1d505f529e88 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a7523db0-e9e8-42aa-879e-1d505f529e88 admin admin] Request method failure captured: Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Accept: application/json Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Accept-Encoding: gzip, deflate Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Connection: keep-alive Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Content-Length: 0 Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Host: 10.222.0.39 Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Openstack-Api-Version: compute 2.92 Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Openstack-System-Scope: None Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: User-Agent: python-novaclient Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Auth-Token: gAAAAABjSNDq8vcOH2E4Opkr1clnly05w9jRqC7vR7dnLg4UqgWWpl4-1kfbsoJ7PsbWI8d307bXFIoS69EDTfpC665i4aOSPi90ReI9nCxA-2oPV4saArOIfxZnSe7S1K50Vh1tihiqzX6s-IZbNl9FiXNmg9lKlvrr8XuM0L2MVjuL16rP3Sw Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Domain-Id: None Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Domain-Name: None Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Identity-Status: Confirmed Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Is-Admin-Project: True Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Domain-Id: default Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Domain-Name: Default Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Project-Name: admin Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Role: member,reader,admin Oct 14 03:00:58.967939 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Roles: member,reader,admin Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e86df8ec1d224299a71e492e2b3fb74d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e86df8ec1d224299a71e492e2b3fb74d"}]}] Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant: admin Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant-Id: e86df8ec1d224299a71e492e2b3fb74d Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-Tenant-Name: admin Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User: admin Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Domain-Id: default Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Domain-Name: Default Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Id: 316b39adbf9f4b0d9c13dc4c11a24e73 Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: X-User-Name: admin Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: method: > Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: exception: Flavor 451 could not be found. Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: action_args: {'id': '451'} Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:00:58.969213 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:58.970025 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: ERROR nova.api.openstack.wsgi Oct 14 03:00:58.971596 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-a7523db0-e9e8-42aa-879e-1d505f529e88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:00:58.972826 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-a7523db0-e9e8-42aa-879e-1d505f529e88 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011309 Oct 14 03:00:58.972826 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Oct 14 03:00:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:00.187696 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:00.188751 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 14 03:01:00.189150 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:01:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:01:00.710845 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-dcb464bf-7ab7-475d-a7eb-a26e1ea3c785 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:01:00.783402 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-dcb464bf-7ab7-475d-a7eb-a26e1ea3c785 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.450577 Oct 14 03:01:00.783873 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Fri Oct 14 03:01:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:01:01.991664 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:01.992653 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001899 Oct 14 03:01:01.993047 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:01:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:01:02.507710 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-0bf03775-07e0-4765-aefa-7d2e8cad2727 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:01:02.565031 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-0bf03775-07e0-4765-aefa-7d2e8cad2727 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.435809 Oct 14 03:01:02.565597 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Fri Oct 14 03:01:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:01:03.765055 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:03.766094 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 14 03:01:03.766527 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:01:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:01:04.277156 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-59827629-f4de-4f7c-9e10-61fa601bed69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:01:04.343293 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-59827629-f4de-4f7c-9e10-61fa601bed69 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.440193 Oct 14 03:01:04.343827 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Fri Oct 14 03:01:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:01:05.552586 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:05.553643 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 14 03:01:05.554074 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:01:06.068263 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-c6bf88ae-b225-442e-bb0b-9fd6e14316a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:01:06.154676 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-c6bf88ae-b225-442e-bb0b-9fd6e14316a9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.465853 Oct 14 03:01:06.155225 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Fri Oct 14 03:01:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:01:07.353219 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:07.354248 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 14 03:01:07.354666 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:01:07.863284 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-ccb2c187-ae51-4494-8bb8-30099dc23f06 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:01:07.884405 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-ccb2c187-ae51-4494-8bb8-30099dc23f06 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.394288 Oct 14 03:01:07.884923 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Fri Oct 14 03:01:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:02:03.879320 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:02:03.880332 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-90aad13f-63c7-4f0c-8266-1e2b5ff39403 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Oct 14 03:02:03.880734 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 931 bytes} [Fri Oct 14 03:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:02:03.891101 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=4 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:04.268693 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-9c69d976-82fb-42ee-9351-fc7b660adc8c admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:02:04.289462 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-9c69d976-82fb-42ee-9351-fc7b660adc8c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402801 Oct 14 03:02:04.290111 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1292 bytes} [Fri Oct 14 03:02:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:02:04.311753 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writing DB stats nova_api:SELECT=14 {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:04.315627 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-1212b869-065e-4720-9e4b-d587223237e1 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:02:04.322788 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-1212b869-065e-4720-9e4b-d587223237e1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012425 Oct 14 03:02:04.323452 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1283 bytes} [Fri Oct 14 03:02:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:02:04.335108 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-02aa3b46-5ef6-4c00-ad90-f68ead7af909 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:02:04.342594 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-02aa3b46-5ef6-4c00-ad90-f68ead7af909 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011130 Oct 14 03:02:04.348098 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1286 bytes} [Fri Oct 14 03:02:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:02:04.355548 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:02:04.363687 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011529 Oct 14 03:02:04.364232 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1286 bytes} [Fri Oct 14 03:02:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:02:04.375649 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-6868a81f-87f6-4e04-b817-4ed022cd5ce9 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:02:04.382857 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-6868a81f-87f6-4e04-b817-4ed022cd5ce9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010777 Oct 14 03:02:04.383365 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1283 bytes} [Fri Oct 14 03:02:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:05:27.898798 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:27.899800 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 14 03:05:27.900193 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:05:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:05:28.042060 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_api:SELECT=6 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:28.183705 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-ece91e20-1f1d-44ce-a528-135c413bdf02 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:28.188573 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-ece91e20-1f1d-44ce-a528-135c413bdf02 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:28.189094 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-ece91e20-1f1d-44ce-a528-135c413bdf02 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:28.189515 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-ece91e20-1f1d-44ce-a528-135c413bdf02 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:28.190249 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-ece91e20-1f1d-44ce-a528-135c413bdf02 admin admin] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:28.190689 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-ece91e20-1f1d-44ce-a528-135c413bdf02 admin admin] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:28.191098 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-ece91e20-1f1d-44ce-a528-135c413bdf02 admin admin] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:28.223385 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-ece91e20-1f1d-44ce-a528-135c413bdf02 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.182481 Oct 14 03:05:28.223935 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Oct 14 03:05:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:05:29.300030 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:29.301034 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 14 03:05:29.301439 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:05:29.495031 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-2902bf70-e871-4ca5-b471-2d1864528623 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:29.498464 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-2902bf70-e871-4ca5-b471-2d1864528623 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:29.499003 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-2902bf70-e871-4ca5-b471-2d1864528623 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:29.499513 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-2902bf70-e871-4ca5-b471-2d1864528623 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:29.500286 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-2902bf70-e871-4ca5-b471-2d1864528623 admin admin] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:29.500730 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-2902bf70-e871-4ca5-b471-2d1864528623 admin admin] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:29.501143 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-2902bf70-e871-4ca5-b471-2d1864528623 admin admin] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:29.520312 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-2902bf70-e871-4ca5-b471-2d1864528623 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.078078 Oct 14 03:05:29.520793 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Oct 14 03:05:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:05:40.991278 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:40.992327 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 14 03:05:40.992726 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:05:41.134695 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_cell0:SELECT=4 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:41.135454 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_cell1:SELECT=4 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:41.136098 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG dbcounter [-] [104267] Writing DB stats nova_api:SELECT=8 {{(pid=104267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:41.183161 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-05a0c870-f0a8-4489-8df1-67445c9c85f0 admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:41.187172 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-05a0c870-f0a8-4489-8df1-67445c9c85f0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:41.187637 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-05a0c870-f0a8-4489-8df1-67445c9c85f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:41.188084 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-05a0c870-f0a8-4489-8df1-67445c9c85f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:41.188755 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-05a0c870-f0a8-4489-8df1-67445c9c85f0 admin admin] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:41.189196 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-05a0c870-f0a8-4489-8df1-67445c9c85f0 admin admin] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:41.189603 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-05a0c870-f0a8-4489-8df1-67445c9c85f0 admin admin] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:41.215461 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-05a0c870-f0a8-4489-8df1-67445c9c85f0 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.085049 Oct 14 03:05:41.215942 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Oct 14 03:05:41 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:05:42.295389 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG nova.api.openstack.wsgi [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] Calling method '>' {{(pid=104266) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:42.296381 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: INFO nova.api.openstack.requestlog [None req-7429b12c-c39b-4668-934f-3a826e0e8b36 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 14 03:05:42.296776 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: [pid: 104266|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Fri Oct 14 03:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:05:42.486026 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG nova.api.openstack.wsgi [None req-21c86ff9-8fbe-4abf-a7ef-29761e75f14b admin admin] Calling method '>' {{(pid=104267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:05:42.489475 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-21c86ff9-8fbe-4abf-a7ef-29761e75f14b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:42.489972 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-21c86ff9-8fbe-4abf-a7ef-29761e75f14b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:42.490393 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-21c86ff9-8fbe-4abf-a7ef-29761e75f14b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:42.491096 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-21c86ff9-8fbe-4abf-a7ef-29761e75f14b admin admin] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:05:42.491539 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-21c86ff9-8fbe-4abf-a7ef-29761e75f14b admin admin] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:05:42.491945 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: DEBUG oslo_concurrency.lockutils [None req-21c86ff9-8fbe-4abf-a7ef-29761e75f14b admin admin] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:05:42.513092 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: INFO nova.api.openstack.requestlog [None req-21c86ff9-8fbe-4abf-a7ef-29761e75f14b admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078295 Oct 14 03:05:42.514256 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: [pid: 104267|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Fri Oct 14 03:05:42 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:06:40.547498 dv-cinder-801522-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 14 03:06:40.548111 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: Fri Oct 14 03:06:40 2022 - graceful shutdown triggered... Oct 14 03:06:40.548568 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: Gracefully killing worker 1 (pid: 104266)... Oct 14 03:06:40.549259 dv-cinder-801522-13-iscsi devstack@n-api.service[104267]: Gracefully killing worker 2 (pid: 104267)... Oct 14 03:06:40.674348 dv-cinder-801522-13-iscsi devstack@n-api.service[104266]: DEBUG dbcounter [-] [104266] Writing DB stats nova_api:SELECT=4 {{(pid=104266) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:06:41.549248 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: worker 1 buried after 1 seconds Oct 14 03:06:41.549815 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: worker 2 buried after 1 seconds Oct 14 03:06:41.549815 dv-cinder-801522-13-iscsi devstack@n-api.service[104265]: goodbye to uWSGI. Oct 14 03:06:41.550779 dv-cinder-801522-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 14 03:06:41.551333 dv-cinder-801522-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 14 03:06:41.554134 dv-cinder-801522-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 14 03:06:41.564023 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 03:06:41 2022] *** Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: nodename: dv-cinder-801522-13-iscsi Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: machine: x86_64 Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: clock source: unix Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: pcre jit disabled Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: detected number of CPU cores: 4 Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: current working directory: / Oct 14 03:06:41.566763 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: detected binary path: /usr/bin/uwsgi-core Oct 14 03:06:41.567441 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: your processes number limit is 47680 Oct 14 03:06:41.567441 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: your memory page size is 4096 bytes Oct 14 03:06:41.567441 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: detected max file descriptor number: 2048 Oct 14 03:06:41.567441 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: lock engine: pthread robust mutexes Oct 14 03:06:41.567441 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: thunder lock: enabled Oct 14 03:06:41.567441 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 14 03:06:41.567441 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 03:06:41.607198 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: Python main interpreter initialized at 0x55cfd172f9c0 Oct 14 03:06:41.607198 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: python threads support enabled Oct 14 03:06:41.607198 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: your server socket listen backlog is limited to 100 connections Oct 14 03:06:41.607198 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: your mercy for graceful operations on workers is 90 seconds Oct 14 03:06:41.607662 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 03:06:41.607662 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: *** Operational MODE: preforking *** Oct 14 03:06:41.608149 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: *** uWSGI is running in multiple interpreter mode *** Oct 14 03:06:41.608149 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: spawned uWSGI master process (pid: 119267) Oct 14 03:06:41.608349 dv-cinder-801522-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 14 03:06:41.611457 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: spawned uWSGI worker 1 (pid: 119283, cores: 1) Oct 14 03:06:41.612013 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: spawned uWSGI worker 2 (pid: 119284, cores: 1) Oct 14 03:06:41.612294 dv-cinder-801522-13-iscsi devstack@n-api.service[119267]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 03:06:42.272673 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 03:06:42.273229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 03:06:43.422916 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 03:06:43.422916 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: from cryptography.utils import int_from_bytes Oct 14 03:06:43.423616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 03:06:43.423616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: from cryptography.utils import int_from_bytes Oct 14 03:06:43.425752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 03:06:43.425752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: from cryptography.utils import int_from_bytes Oct 14 03:06:43.426232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 03:06:43.426232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: from cryptography.utils import int_from_bytes Oct 14 03:06:45.855174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 03:06:45.855778 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 03:06:45.856480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 03:06:45.856851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 03:06:45.857106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 03:06:45.857595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.857939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.858264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.858588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.858919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.859499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.859822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.860142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.860470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.860732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.861050 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.861514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-13-iscsi {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.861867 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.862202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.862514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.862830 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.862919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 03:06:45.863287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 03:06:45.863371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.863445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.863608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 03:06:45.863751 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.863963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 03:06:45.864224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 03:06:45.864331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.864615 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.864746 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.864944 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.865062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.865267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.865387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.865590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.865716 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.865927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.866064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.866242 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.866389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.866566 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.866701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.866871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.867004 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.867196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.867330 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.867452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.867569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.867764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.867907 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-13-iscsi {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.868225 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.868358 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-13-iscsi {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.868535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.868656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.868847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.868980 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.869162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.869286 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.869487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.869612 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.869819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.869963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.870150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.870287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.870469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.870617 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.870785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.870984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.871130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.871300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.871432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.872194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.873231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.873384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.873518 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.873659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.873819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.873966 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.874114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.874256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.874399 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.874537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.874675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.874821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.874975 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875427 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875511 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-13-iscsi {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875683 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875867 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.875958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.876055 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.876146 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.876284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.876431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.876607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.876709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.876917 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.877022 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.877225 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.877332 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.877533 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.877638 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.877862 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.877987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.878220 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.878335 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.878469 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.878574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.878774 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.878879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.879079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.879175 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.879380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.879472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.879697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.879833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.880006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.880106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.880322 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.880413 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.880628 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.880732 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.880934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.881026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.881189 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.881328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.881499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.881609 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.881851 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.881948 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.882181 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.882284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.882508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.882618 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.882764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.882867 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.883018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.883111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.883339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.883440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.883660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.883751 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.883969 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.884080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.884280 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.884385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.884588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.884689 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.884898 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.884998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.885207 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.885300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.885458 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.885550 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.885791 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.885907 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.886082 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.886182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.886402 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.886506 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.886721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.886832 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.887010 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.887114 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.887345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.887444 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.887646 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.887748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.887952 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.888051 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.888273 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.888368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.888560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.888665 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.888882 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.888984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.889167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.889269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.889474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.889575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.889861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.889981 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.890176 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.890280 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.890482 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.890576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.890786 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.890877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.891093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.891192 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.891410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.891509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.891715 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.891816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.892021 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.892119 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.892279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.892371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.892585 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.892686 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.892895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.892995 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.893215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.893307 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.893520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.893625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.893852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.893958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.894161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.894260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.894465 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.894571 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.894774 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.894870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.895078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.895174 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.895382 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.895483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.895688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.895787 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.895985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.896121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.896291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.896393 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.896597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.896689 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.896900 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.897002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.897208 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.897307 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.897509 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.897601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.897840 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.897957 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.898144 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.898246 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.898450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.898552 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.898750 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.898851 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.899052 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.899152 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.899352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.899446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.899667 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.899759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.899975 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.900073 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.900278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.900370 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.900582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.900683 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.900882 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.900975 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.901187 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.901326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.901508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.901600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.901842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.901964 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.902156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.902250 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.902478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.902570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.902801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.902907 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.903114 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.903214 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.903435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.903526 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.903747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.903853 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.904056 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.904183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.904362 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.904488 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.904670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.904819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.904978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.905075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.905284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.905383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.905588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.905693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.905928 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.906089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.906216 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.906327 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.906543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.906652 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.906868 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.906961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.907179 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.907282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.907487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.907581 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.907794 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.907896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.908116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 03:06:45.908208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.908437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.908530 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.908752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.908880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.909095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.909203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.909420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.909522 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.909745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.909858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.910091 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.910195 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.910412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.910514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.910721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.910821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.911032 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.911125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.911344 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.911446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.911661 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.911761 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.911977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.912079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.912287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.912389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.912604 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.912705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.912917 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.913010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.913239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.913333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.913551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.913644 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.913884 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.913982 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.914197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.914293 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.914508 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.914611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.914818 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.914928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.915151 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.915246 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.915461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.915560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.915781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.915883 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.916094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.916193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.916404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.916505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.916718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.916821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.917034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.917162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.917343 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.917437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.917651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.917822 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.917980 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.918108 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.918284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.918378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.919097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.919232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.919407 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.919502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.919710 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.919811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.920030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.920132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.920358 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.920452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.920668 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.920760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.921000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.921093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.921306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.921405 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.921614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.921708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.921949 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.922052 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.922262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.922362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.922569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.922675 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.922880 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.922973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.923191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.923292 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.923495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.923599 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.923820 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.923914 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.924130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.924230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.924435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.924547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.924746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.924850 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.925051 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.925182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.925357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.925459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.925665 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.925786 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.925999 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.926101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.926308 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.926415 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.926615 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.926707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.926922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.927013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.927244 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.927346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.927570 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.927663 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.927862 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.927961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.928188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.928287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.928503 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.928595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.928805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.928897 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.929123 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.929216 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.929434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.929527 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.929748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.929884 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.930075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.930185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.930387 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.930505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.930685 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.930832 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.931019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.931287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.931382 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.931595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.931690 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.931907 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.932002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.932213 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.932307 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.932518 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.932612 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.932822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.932958 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.933128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.933220 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.933433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.933527 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.933745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.933874 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.934146 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.934770 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.934964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.935100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.935279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.935380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.935580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.935680 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.935924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.936032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.936231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.936326 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.936557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.936657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.936886 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.936989 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.937204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.937297 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.937510 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.937605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.937847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.937960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.938158 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.938259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.938465 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.938567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.938775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.938868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.939085 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.939220 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.939390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.939493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.939697 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.939790 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.940002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.940094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.940310 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.940410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.940617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.940755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.940939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.941039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.941250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.941342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.941556 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.941657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.941882 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.941989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.942188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.942295 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.942529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.942621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.942833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.942925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.943165 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.943266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.943487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.943580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.943799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.943892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.944112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.944214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.944422 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.944515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.944732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.944863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.945042 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.945151 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.945350 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.945489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.945663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.945826 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.945995 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.946089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.946313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.946414 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.946622 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.946723 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.946943 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.947036 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.947250 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.947342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.947573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.947673 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.947876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.947970 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.948189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.948281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.948494 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.948585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.948819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.948921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.949125 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.949219 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.949435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.949530 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.949791 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.949902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.950109 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.950202 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.950420 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.950521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.950730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.950868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.951044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.951163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.951353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.951469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.951660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.951752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.951973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.952065 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.952281 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.952396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.952590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.952690 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.952895 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.952994 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.953206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.953307 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.953511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.953611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.953849 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.953956 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.954155 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.954248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.954460 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.954559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.954775 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.954876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.955084 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.955214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.955405 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.955532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.955726 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.955820 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.956028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.956129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.956332 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.956424 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.956647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.956738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.956953 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.957053 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.957255 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.957347 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.957562 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.957710 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.957889 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.957983 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.958202 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.958306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.958519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.958620 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.958820 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.958913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.959132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.959223 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.959441 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.959547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.959747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.959875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.960057 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.960162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.960364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.960467 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.960670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.960764 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.960983 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.961075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.961294 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.961386 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.961603 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.961701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.961936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.962032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.962249 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.962343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.962560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.962660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.962865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.962958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.963185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.963279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.963494 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.963586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.963802 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.963894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.964107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.964199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.964410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.964505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.964720 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.964839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.965037 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.965131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.965366 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.965635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.965736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.965992 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.966097 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.966307 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.966401 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.966627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.966729 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.966940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.967041 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.967254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.967362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.967581 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.967675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.967897 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.967993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.968210 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.968313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.968514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.968607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.968822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.968916 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.969128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.969230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.969432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.969561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.969742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.969865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.970067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.970179 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.970371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.970476 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.970675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.970770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.970982 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.971122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.971284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.971387 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.971588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.971681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.971892 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.972159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.972253 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.972496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.972597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.972799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.972900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.973109 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.973209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.973414 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.973516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.973777 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.973890 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.974090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.974190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.974394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.974496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.974696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.974790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.974998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.975099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.975322 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.975423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.975632 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.975728 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.975940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.976042 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.976253 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.976355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.976560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.976662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.976870 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.976973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.977178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.977281 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.977490 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.977591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.977818 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.977934 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.978131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.978601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.978601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.978783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.978909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.979018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.979106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.979190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.979313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.979407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.979622 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.979726 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.979931 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.980033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.980242 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.980346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.980550 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.980645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.980850 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.981451 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.981679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.981842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.982007 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.982103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.982326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.982420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.982638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.982740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.982944 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.983039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.983248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.983342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.983561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.983663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.983870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.983964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.984440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.984579 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.984752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.984855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.985055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.985157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.985370 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.985508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.985675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.985849 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.986004 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.986099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.986309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.986403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.986613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.986755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.986918 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.987046 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.987220 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.987317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.987531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.987638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.987844 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.987936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.988146 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.988239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.988447 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.988542 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.988752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.988851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.989053 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.989153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.989354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.989455 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.989661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.989845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.989994 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.990086 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.990310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.990413 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.990612 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.990707 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.990920 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.991012 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.991221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.991322 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.991524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.991662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.991827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.991931 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.992133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.992235 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.992436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.992537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.992736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.992915 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.993037 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.993131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.993339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.993440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.993640 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.993743 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.993983 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.994090 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.994291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.994393 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.994594 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.994888 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.994888 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.995143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.995233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.995325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.995487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.995580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.995793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.995888 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.996104 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.996208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.996429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.996522 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.997291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.997389 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.997600 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.997708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.997940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.998043 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.998247 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.998340 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.998555 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.998662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.998861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.998963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.999220 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.999322 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.999485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.999593 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.999790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:45.999940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.000091 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.000193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.000395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.000490 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.000699 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.000794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.001015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.001108 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.001325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.001450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.001960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002059 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002205 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002897 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.002989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.003208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.003293 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.003517 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.003608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.003829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.003922 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.004141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.004224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.004454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.004538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.004771 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.004882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.005080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.005164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.005388 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.005469 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.007322 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008004 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008092 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008167 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008414 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008701 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008772 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008853 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.008934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009007 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009469 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009617 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.009930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010015 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010089 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010258 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010332 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010673 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010771 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.010922 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.011018 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.011237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.011348 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.011552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.011633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.011857 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.011949 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.012192 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.012286 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.012507 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.012599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.012826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.012918 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.013142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.013225 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.013452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.013536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.013820 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.013910 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.014112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.014195 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.014420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.014514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.014732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.014831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.015042 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.015150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.015345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.015478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.015654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.015799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.015962 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.016093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.016283 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.016428 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.016700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.016797 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.017009 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.017111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.017315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.017421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.017628 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.017721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.018045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.018139 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.018360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.018468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.018668 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.018762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.018998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.019100 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.019324 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.019419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.019630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.019724 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.019947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.020041 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.020259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.020354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.020584 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.020687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.020895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.020990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.021212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.021306 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.021519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.021611 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.021850 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.022002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.022157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.022251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.022484 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.022578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.022794 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.022901 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.023115 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.023215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.023531 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.023627 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.023847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.023941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.024163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.024264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.024481 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.024589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.024809 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.024904 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.025122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.025245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.025435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.025557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.025747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.025904 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.026075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.026180 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.026384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.026529 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.026709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.026806 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.027015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.027112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.027326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.027430 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.027639 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.027767 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.027976 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.028071 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.028282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.028384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.028585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.028679 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.028907 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.029001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.029211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.029314 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.029534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.029637 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.029870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.029981 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.030195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.030297 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.030515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.030621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.030819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.030913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.031144 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.031237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.031440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.031536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.031745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.031855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.032133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.032240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.032355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.032450 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.032700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.032810 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.033005 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.033107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.033326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.033421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.033652 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.033772 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.034004 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.034098 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.034316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.034418 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.034625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.034732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.034936 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.035038 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.035248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.035361 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.035565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.035659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.035873 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.035967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.036193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.036301 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.036498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.036645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.036801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.036907 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.037110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.037203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.037413 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.037509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.037721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.037867 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.038046 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.038142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.038353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.038447 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.038655 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.038749 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.038957 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.039067 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.039259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.039361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.039579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.039682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.039885 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.039989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.040207 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.040308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.040515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.040610 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.040821 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.040930 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.041124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.041227 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.041425 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.041519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.041779 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.041890 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.042089 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.042209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.042422 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.042539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.042728 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.042824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.043046 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.043148 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.043357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.043959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.044178 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.044274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.044484 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.044577 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.044793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.044887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.045101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.045197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.045412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.045520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.045716 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.045829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.046046 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.046149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.046352 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.046454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.046664 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.046811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.046976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.047079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.047301 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.047519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.047614 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.047848 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.047951 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.048161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.048263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.048476 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.048572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.048789 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.048884 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.049101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.049203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.049416 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.049512 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.049730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.049973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.050060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.050145 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.050363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.050472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.050672 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.050767 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.050992 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.051131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.051310 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.051416 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.051626 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.051721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.051941 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.052044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.052273 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.052404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.052574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.052688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.052884 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.052987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.053199 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.053301 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.053521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.053616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.053876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.054105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.054219 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.054440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.054534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.054758 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.054855 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.055073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.055175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.055381 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.055493 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.055696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.055825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.056005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.056135 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.056317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.056594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.056707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.056915 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.057032 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.057222 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.057367 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.057534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.057629 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.057878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.057996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.058210 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.058319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.058530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.058623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.058844 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.058978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.059704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.059829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.060025 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.060120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.060350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.060547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.060668 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.060862 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.061029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.061201 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.061340 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.061508 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.061640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.061851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.061984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.062173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.062304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.062492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.062611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.062825 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.062941 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.063129 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.063233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.063435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.063536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.063747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.063849 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.064055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.064165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.064360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.064464 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.064681 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.064795 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.064990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.065085 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.065295 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.065397 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.065617 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.065746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.065952 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.066060 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.066294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.066483 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.066613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.066835 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.066931 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.067153 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.067445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.067538 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.067761 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.067864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.068100 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.068202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.068412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.068504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.068737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.068832 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.069047 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.069141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.069353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.069448 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.069667 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.069804 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.070002 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.070105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.070307 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.070402 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.070613 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.070709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.070924 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.071025 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.071230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.071337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.071535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.071641 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.071854 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.071947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.072163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.072268 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.072484 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.072579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.072790 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.073036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.073142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.073327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.073475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.073731 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.073888 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.074082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.074184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.074396 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.074498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.074727 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.074829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.075034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.075137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.075345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.075440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.075663 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.075821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.075976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.076079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.076286 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.076382 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.076605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.076707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.076919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.077027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.077230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.077333 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.077539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.077641 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.077878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.077991 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.078197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.078298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.078503 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.078596 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.078816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.078918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.079120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.079224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.079440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.079541 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.079752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.079858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.080061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.080190 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.080372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.080509 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.080689 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.080785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.080998 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.081223 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.081318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.081556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.081659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.081913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.082013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.082230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.082334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.082539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.082635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.082866 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.082968 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.083172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.083270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.083478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.083584 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.083801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.083903 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.084113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.084215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.084424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.084519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.084734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.084836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.085043 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.085148 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.085352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.085455 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.085661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.085840 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.085993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.086102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.086301 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.086396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.086610 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.086705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.086919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.087062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.087227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.087350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.087535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.087664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.087844 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.088094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.088191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.088436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.088529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.088763 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.088902 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.089088 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.089181 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.089403 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.089504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.089718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.089852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.090055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.090156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.090387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.090485 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.090695 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.090875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.091006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.091109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.091316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.091410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.091629 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.091771 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.091944 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.092045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.092255 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.092356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.092559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.092661 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.092870 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.092972 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.093185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.093279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.093498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.093599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.093839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.093958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.094156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.094265 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.094467 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.094606 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.094780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.094874 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.095092 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.095197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.095408 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.095503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.095716 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.095808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.096043 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.096147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.096370 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.096463 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.096691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.096794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.097010 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.097112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.097316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.097445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.097621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.097752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.097961 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.098057 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.098274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.098368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.098589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.098682 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.098895 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.098989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.099196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.099290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.099496 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.099590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.099802 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.099940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.100102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.100261 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.100403 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.100582 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.100704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.100905 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.100999 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.101218 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.101321 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.101546 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.101647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.101895 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.102004 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.102199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.102300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.102499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.102600 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.102799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.102893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.103099 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.103203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.103404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.103506 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.103704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.103843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.104006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.104111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.104305 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.104399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.104604 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.104698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.104901 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.105007 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.105230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.105325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.105557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.105651 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.106452 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.106581 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.106705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.106808 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.107012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.107117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.107324 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.107427 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.107629 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.107729 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.107932 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.108035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.108240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.108336 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.108545 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.108639 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.108855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.108953 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.109432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.109565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.109739 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.109909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.110074 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.110176 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.110383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.110480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.110689 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.110789 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.110993 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.111101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.111301 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.111394 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.111603 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.111696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.111907 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.112015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.112209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.112311 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.112513 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.112607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.112817 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.112924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.113145 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.113238 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.113461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.113599 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.113813 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.113913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.114120 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.114215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.114428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.114522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.114739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.114835 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.115588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.115713 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.115713 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.115885 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.115981 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116077 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116259 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116839 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.116956 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.117150 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.117254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.117476 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.117619 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.117821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.117966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.118133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.118242 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.118445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.118546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.118775 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.118877 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.119106 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.119210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.119415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.119509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.119742 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.120063 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.120160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.120374 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.120469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.120684 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.120788 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.120989 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.121086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.121234 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 03:06:46.121336 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.122184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.122504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.122816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.123130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.123442 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.123760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.124074 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.124387 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.124704 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.125021 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.125351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.125678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.126018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.126350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.126679 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.127031 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.127346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.127690 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.128020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.128338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.128652 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.128960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 03:06:46.129207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 03:06:46.184792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO dbcounter [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Registered counter for database nova_api Oct 14 03:06:46.190852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO dbcounter [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Registered counter for database nova_api Oct 14 03:06:46.204974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_db.sqlalchemy.engines [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:46.210645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_db.sqlalchemy.engines [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:46.211889 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writer thread running {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:46.218126 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writer thread running {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:46.269487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.context [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dccde63-09d3-408b-8840-86bc0620ec2d(cell1) {{(pid=119284) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 03:06:46.273495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:06:46.274015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:06:46.274641 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.context [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4dccde63-09d3-408b-8840-86bc0620ec2d(cell1) {{(pid=119283) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 03:06:46.275589 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:06:46.276331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:06:46.276797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:06:46.279338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:06:46.279874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:06:46.280355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:06:46.281347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO dbcounter [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Registered counter for database nova_cell0 Oct 14 03:06:46.282104 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:06:46.282919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:06:46.283414 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:06:46.285433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO dbcounter [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Registered counter for database nova_cell1 Oct 14 03:06:46.285548 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:06:46.287613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO dbcounter [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Registered counter for database nova_cell0 Oct 14 03:06:46.291584 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO dbcounter [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Registered counter for database nova_cell1 Oct 14 03:06:46.292714 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_db.sqlalchemy.engines [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:46.294940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_db.sqlalchemy.engines [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:46.300110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_db.sqlalchemy.engines [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:46.301487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writer thread running {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:46.304515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_db.sqlalchemy.engines [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:46.304646 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writer thread running {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:46.310866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writer thread running {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:46.312933 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writer thread running {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:46.449673 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO dbcounter [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Registered counter for database nova_cell0 Oct 14 03:06:46.456670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_db.sqlalchemy.engines [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:46.459900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO dbcounter [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Registered counter for database nova_cell0 Oct 14 03:06:46.461520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writer thread running {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:46.467165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_db.sqlalchemy.engines [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 03:06:46.472043 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writer thread running {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 03:06:46.785183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: WARNING keystonemiddleware.auth_token [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 03:06:46.792551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: WARNING keystonemiddleware.auth_token [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 03:06:46.792759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: WARNING keystonemiddleware.auth_token [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 03:06:46.800045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: WARNING keystonemiddleware.auth_token [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 03:06:47.139195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: WARNING keystonemiddleware.auth_token [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 03:06:47.145203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: WARNING keystonemiddleware.auth_token [None req-12f63c8c-de7e-4fc5-a3ff-81cffc74c4e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 03:06:47.145389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: WARNING keystonemiddleware.auth_token [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 03:06:47.150500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfd172f9c0 pid: 119284 (default app) Oct 14 03:06:47.151328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: WARNING keystonemiddleware.auth_token [None req-daa23218-5f7a-44fa-9a13-5d13c7dee565 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 03:06:47.156609 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfd172f9c0 pid: 119283 (default app) Oct 14 03:07:21.561321 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:21.562318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:21.563164 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:21.564189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:23.116149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f3f47401-a7ee-45e2-b2f3-fe861981b5a7 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Action: 'create', calling method: .version_select at 0x7f2bec9324c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-476588679", "metadata": {"Type": "work"}}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f3f47401-a7ee-45e2-b2f3-fe861981b5a7 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Request method failure captured: Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 121 Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJpZRaql5rfe8ajwGy-wIpYprTzoz10wWbN4H2A5ZiZ6y-t_rrEyAjWb4hBMOU15BRSAg_Qro7PELmLsEncmn1Z01KF67enEFMewdx0aONbU_7I0gvr9iHoaXdiYrG_RtQt_zOEdm1zAPoYLms8Zq3HvE3tiCS9YVmNW-OqwHEwbqs Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:07:23.122591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c48dec42cfcb4cd4a60a97758c3caa4a"}]}] Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: f06b7e2bb0f8440faf93060e4311468f Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-476588679", "metadata": {"Type": "work"}}} Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: Oct 14 03:07:23.124189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-476588679', 'metadata': {'Type': 'work'}}}} Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise error Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi '#$%' Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:23.125143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 03:07:23.126775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 03:07:23.128141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 03:07:23.128141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.128141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f3f47401-a7ee-45e2-b2f3-fe861981b5a7 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:23.128141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f3f47401-a7ee-45e2-b2f3-fe861981b5a7 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.575583 Oct 14 03:07:23.128141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1156 bytes} [Fri Oct 14 03:07:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1579 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:07:23.137387 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=3 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:23.139353 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=3 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:23.139353 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=3 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:23.139856 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=3 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:23.362545 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-63d642a3-5097-4108-9d52-8fd1f6429926 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Action: 'create', calling method: .version_select at 0x7f2bec97c0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2099691641", "metadata": {"Type": "work"}}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-63d642a3-5097-4108-9d52-8fd1f6429926 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Request method failure captured: Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 120 Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJpZRaql5rfe8ajwGy-wIpYprTzoz10wWbN4H2A5ZiZ6y-t_rrEyAjWb4hBMOU15BRSAg_Qro7PELmLsEncmn1Z01KF67enEFMewdx0aONbU_7I0gvr9iHoaXdiYrG_RtQt_zOEdm1zAPoYLms8Zq3HvE3tiCS9YVmNW-OqwHEwbqs Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:07:23.368616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c48dec42cfcb4cd4a60a97758c3caa4a"}]}] Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: f06b7e2bb0f8440faf93060e4311468f Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2099691641", "metadata": {"Type": "work"}}} Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: Oct 14 03:07:23.374239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2099691641', 'metadata': {'Type': 'work'}}}} Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise error Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi '0' Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:23.375045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 03:07:23.376364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 03:07:23.377462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 03:07:23.377462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.377462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-63d642a3-5097-4108-9d52-8fd1f6429926 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:23.377462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-63d642a3-5097-4108-9d52-8fd1f6429926 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.239038 Oct 14 03:07:23.377462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 1/2] 10.222.0.39 () {60 vars in 1156 bytes} [Fri Oct 14 03:07:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:07:23.385171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2c4a30b5-8e87-48cf-ae3d-2e0da295d04d tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Action: 'create', calling method: .version_select at 0x7f2bec932e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-322281327", "metadata": {"Type": "work"}}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2c4a30b5-8e87-48cf-ae3d-2e0da295d04d tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Request method failure captured: Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 118 Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJpZRaql5rfe8ajwGy-wIpYprTzoz10wWbN4H2A5ZiZ6y-t_rrEyAjWb4hBMOU15BRSAg_Qro7PELmLsEncmn1Z01KF67enEFMewdx0aONbU_7I0gvr9iHoaXdiYrG_RtQt_zOEdm1zAPoYLms8Zq3HvE3tiCS9YVmNW-OqwHEwbqs Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:07:23.390251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c48dec42cfcb4cd4a60a97758c3caa4a"}]}] Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: f06b7e2bb0f8440faf93060e4311468f Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-322281327", "metadata": {"Type": "work"}}} Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: Oct 14 03:07:23.396185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-322281327', 'metadata': {'Type': 'work'}}}} Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise error Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi '' Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:23.397112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 03:07:23.398515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 03:07:23.401353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 03:07:23.401353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:23.401353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2c4a30b5-8e87-48cf-ae3d-2e0da295d04d tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:23.401353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2c4a30b5-8e87-48cf-ae3d-2e0da295d04d tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010104 Oct 14 03:07:23.401353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1156 bytes} [Fri Oct 14 03:07:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:07:23.409625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7943e0ed-9169-40a1-9259-8bb2fef23ba4 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Calling method '.version_select at 0x7f2bec97cdc0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:24.459354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-7943e0ed-9169-40a1-9259-8bb2fef23ba4 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] HTTP exception thrown: Volume tempest-invalid-1508625039 could not be found. Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7943e0ed-9169-40a1-9259-8bb2fef23ba4 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Request method failure captured: Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1508625039 HTTP/1.1 Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJpZRaql5rfe8ajwGy-wIpYprTzoz10wWbN4H2A5ZiZ6y-t_rrEyAjWb4hBMOU15BRSAg_Qro7PELmLsEncmn1Z01KF67enEFMewdx0aONbU_7I0gvr9iHoaXdiYrG_RtQt_zOEdm1zAPoYLms8Zq3HvE3tiCS9YVmNW-OqwHEwbqs Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:07:24.465574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c48dec42cfcb4cd4a60a97758c3caa4a"}]}] Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: f06b7e2bb0f8440faf93060e4311468f Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Volume tempest-invalid-1508625039 could not be found. Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'tempest-invalid-1508625039'} Oct 14 03:07:24.467144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1508625039 could not be found. (HTTP 404) (Request-ID: req-ea5b307c-912a-4663-bd85-98909f1789a6) Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:24.468984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:07:24.470390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1508625039 could not be found. Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:07:24.471745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1508625039 could not be found. Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1508625039 could not be found. Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7943e0ed-9169-40a1-9259-8bb2fef23ba4 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Returning 404 to user: Volume tempest-invalid-1508625039 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:24.473426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7943e0ed-9169-40a1-9259-8bb2fef23ba4 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1508625039" status: 404 len: 99 microversion: 2.1 time: 1.070669 Oct 14 03:07:24.488298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1218 bytes} [Fri Oct 14 03:07:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1508625039 => generated 99 bytes in 1081 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 14 03:07:24.488921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a6851660-0f80-44f0-be0f-a338a260e61e tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004424 Oct 14 03:07:24.488921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1140 bytes} [Fri Oct 14 03:07:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 14 03:07:24.504750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1a9caaa6-eadb-496a-9ea2-c88c96c57940 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009505 Oct 14 03:07:24.508860 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 3/6] 10.222.0.39 () {58 vars in 1137 bytes} [Fri Oct 14 03:07:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 14 03:07:24.514973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-10dcc67f-9b77-4cf3-983e-01b8285e40a3 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Calling method '.version_select at 0x7f2bec7ef4c0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:25.293323 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-10dcc67f-9b77-4cf3-983e-01b8285e40a3 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] HTTP exception thrown: Volume b32a39da-b997-4c32-8ba7-bb8deda3d032 could not be found. Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-10dcc67f-9b77-4cf3-983e-01b8285e40a3 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Request method failure captured: Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/os-volumes/b32a39da-b997-4c32-8ba7-bb8deda3d032 HTTP/1.1 Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJpZRaql5rfe8ajwGy-wIpYprTzoz10wWbN4H2A5ZiZ6y-t_rrEyAjWb4hBMOU15BRSAg_Qro7PELmLsEncmn1Z01KF67enEFMewdx0aONbU_7I0gvr9iHoaXdiYrG_RtQt_zOEdm1zAPoYLms8Zq3HvE3tiCS9YVmNW-OqwHEwbqs Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:07:25.298417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c48dec42cfcb4cd4a60a97758c3caa4a"}]}] Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: f06b7e2bb0f8440faf93060e4311468f Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Volume b32a39da-b997-4c32-8ba7-bb8deda3d032 could not be found. Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'b32a39da-b997-4c32-8ba7-bb8deda3d032'} Oct 14 03:07:25.300079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b32a39da-b997-4c32-8ba7-bb8deda3d032 could not be found. (HTTP 404) (Request-ID: req-e04d8236-0cd2-47dc-b430-0a6701e74024) Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:25.300977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:07:25.302284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b32a39da-b997-4c32-8ba7-bb8deda3d032 could not be found. Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 03:07:25.305412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b32a39da-b997-4c32-8ba7-bb8deda3d032 could not be found. Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b32a39da-b997-4c32-8ba7-bb8deda3d032 could not be found. Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-10dcc67f-9b77-4cf3-983e-01b8285e40a3 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Returning 404 to user: Volume b32a39da-b997-4c32-8ba7-bb8deda3d032 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-10dcc67f-9b77-4cf3-983e-01b8285e40a3 tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/b32a39da-b997-4c32-8ba7-bb8deda3d032" status: 404 len: 109 microversion: 2.1 time: 0.790719 Oct 14 03:07:25.307773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:07:24 2022] DELETE /compute/v2.1/os-volumes/b32a39da-b997-4c32-8ba7-bb8deda3d032 => generated 109 bytes in 792 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:07:25.310596 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-68b7dbd0-e132-417d-92bc-55ace3f13acf tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Calling method '.version_select at 0x7f2bec76b8b0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:25.369006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-68b7dbd0-e132-417d-92bc-55ace3f13acf tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] HTTP exception thrown: Volume 95405195-f00d-48ab-9120-00bdcf564d66 could not be found. Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-68b7dbd0-e132-417d-92bc-55ace3f13acf tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Request method failure captured: Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/os-volumes/95405195-f00d-48ab-9120-00bdcf564d66 HTTP/1.1 Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJpZRaql5rfe8ajwGy-wIpYprTzoz10wWbN4H2A5ZiZ6y-t_rrEyAjWb4hBMOU15BRSAg_Qro7PELmLsEncmn1Z01KF67enEFMewdx0aONbU_7I0gvr9iHoaXdiYrG_RtQt_zOEdm1zAPoYLms8Zq3HvE3tiCS9YVmNW-OqwHEwbqs Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:07:25.371977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c48dec42cfcb4cd4a60a97758c3caa4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c48dec42cfcb4cd4a60a97758c3caa4a"}]}] Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: c48dec42cfcb4cd4a60a97758c3caa4a Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-VolumesNegativeTest-150301725 Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: f06b7e2bb0f8440faf93060e4311468f Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-VolumesNegativeTest-150301725-project Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Volume 95405195-f00d-48ab-9120-00bdcf564d66 could not be found. Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '95405195-f00d-48ab-9120-00bdcf564d66'} Oct 14 03:07:25.373313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95405195-f00d-48ab-9120-00bdcf564d66 could not be found. (HTTP 404) (Request-ID: req-dded806e-5c3c-4c25-91b4-62888a025d59) Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:25.374142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:07:25.375361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95405195-f00d-48ab-9120-00bdcf564d66 could not be found. Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 03:07:25.377073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95405195-f00d-48ab-9120-00bdcf564d66 could not be found. Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95405195-f00d-48ab-9120-00bdcf564d66 could not be found. Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-68b7dbd0-e132-417d-92bc-55ace3f13acf tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] Returning 404 to user: Volume 95405195-f00d-48ab-9120-00bdcf564d66 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-68b7dbd0-e132-417d-92bc-55ace3f13acf tempest-VolumesNegativeTest-150301725 tempest-VolumesNegativeTest-150301725-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/95405195-f00d-48ab-9120-00bdcf564d66" status: 404 len: 109 microversion: 2.1 time: 0.074665 Oct 14 03:07:25.390597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:07:25 2022] GET /compute/v2.1/os-volumes/95405195-f00d-48ab-9120-00bdcf564d66 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:07:41.924070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fb39ddb7-d72f-4fd5-997f-1e0abe79529b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: .version_select at 0x7f2bec776ee0>, body: {"keypair": {"name": "tempest-keypair-2065246945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBjA1BBeut3pbtD2Mmfcxz4rV7YWak4iZBguNdk0kWA4fvVw6Vla7iRCsIw4xD29PgHCXHKTu6MviLyhb5IeOTswAHaIfo7QqAXdQvRrjZsbvIOTYpJvPmcVzX9X/GVHw=="}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:42.040699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-fb39ddb7-d72f-4fd5-997f-1e0abe79529b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for project 20fb24be77624e59b8560c7863ca4a46. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:42.058963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-fb39ddb7-d72f-4fd5-997f-1e0abe79529b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for user 410b7c9e93c94ce78d1b5c0e646307a2 and project 20fb24be77624e59b8560c7863ca4a46. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:42.213825 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fb39ddb7-d72f-4fd5-997f-1e0abe79529b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.162333 Oct 14 03:07:42.214978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 5/9] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:07:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:42.911246 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1235942905", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:43.095334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-87053bba-e384-497d-9586-fdfca8ab1fd6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'create', calling method: .version_select at 0x7f2bec6f2790>, body: {"keypair": {"name": "tempest-keypair-1902552501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCunP7P7m6mzPdj6lSMOFNxLgRXuuwXhyvWXB15O7lMdFJnAL2drJYz+L2Y0qSvcTMvKwBKEau6YcxToSrP+C/2b7tIeurLGrq4dlF98+eydvH+7IvVMtPYSQLotYCEGZA=="}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:43.138985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] validate_networks() for [('55f1e2d7-2b20-46bb-a21a-28526552f799', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:43.159123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-87053bba-e384-497d-9586-fdfca8ab1fd6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Getting quotas for project 55f278e0f09c45ca8ab33cd9e102446c. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:43.167978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-87053bba-e384-497d-9586-fdfca8ab1fd6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Getting quotas for user ab344e29f747423fb8766f2d8fbfef0b and project 55f278e0f09c45ca8ab33cd9e102446c. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:43.318894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-87053bba-e384-497d-9586-fdfca8ab1fd6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.778848 Oct 14 03:07:43.320520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 6/10] 10.222.0.39 () {62 vars in 1200 bytes} [Fri Oct 14 03:07:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 782 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 14 03:07:46.154684 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:46.155216 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:46.155800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:46.156313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:46.156826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:46.200894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:46.201633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:46.202972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:46.203957 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:46.204634 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:46.205288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:46.286329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Getting quotas for project 44d8a8798bc64aefadd52c30a21002ef. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:46.293293 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Getting quotas for user 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b and project 44d8a8798bc64aefadd52c30a21002ef. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:46.313701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:46.317031 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:46.497395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-76f63814-64d8-45a7-85df-bcdd3eb70f6e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'create', calling method: .version_select at 0x7f2bec6a6820>, body: {"keypair": {"name": "tempest-keypair-19140152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgZ2o13dtprJfE31wf6c/OGfCKCsXSpZxuX3+Il36iyqt1TIIkS8twF0Bs5RMHk6MI/hrAbnBY9KcavA29J+4f1pLIlvX9u5Nmj+JqvmqxGJ38dxCw49ndUOL3dB3+buw=="}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:46.531152 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-53ff2de0-a87e-40a8-b590-6c8d2469446b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.150240 Oct 14 03:07:46.532072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 5/11] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 4152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:07:46.549621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3783001a-f141-4623-9feb-a7c2b54d282f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:46.550329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3783001a-f141-4623-9feb-a7c2b54d282f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:46.596249 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-76f63814-64d8-45a7-85df-bcdd3eb70f6e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Getting quotas for project 5470d8ee28f74b4eb385a90c33a514b8. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:46.614588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-76f63814-64d8-45a7-85df-bcdd3eb70f6e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Getting quotas for user fb1c279c2f7f404ab9c846a3ba594886 and project 5470d8ee28f74b4eb385a90c33a514b8. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:46.720536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3783001a-f141-4623-9feb-a7c2b54d282f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:46.761168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3783001a-f141-4623-9feb-a7c2b54d282f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1222 microversion: 2.1 time: 0.212598 Oct 14 03:07:46.762670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:46 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:07:46.855060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-76f63814-64d8-45a7-85df-bcdd3eb70f6e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.750577 Oct 14 03:07:46.856474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 7/13] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:07:46 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:07:47.216467 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-263771729", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:47.339535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] validate_networks() for [('55f1e2d7-2b20-46bb-a21a-28526552f799', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:47.894586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-108586530", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "networks": [{"uuid": "83101ad8-0b91-4e38-8556-3ebbb1384853"}]}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:48.063703 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] validate_networks() for [('83101ad8-0b91-4e38-8556-3ebbb1384853', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:49.766207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:49.767802 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:49.768776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:49.769596 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:49.770646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:49.799032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:49.799840 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:49.810380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:49.811572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:49.824895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:49.825407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:49.886250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Getting quotas for project 44d8a8798bc64aefadd52c30a21002ef. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:49.897130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Getting quotas for user 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b and project 44d8a8798bc64aefadd52c30a21002ef. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:49.944526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:49.954631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:50.183819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ccecc656-2db1-48ce-b057-4ee7b53d633e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.973483 Oct 14 03:07:50.186089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 7/14] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:07:50.203831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c0c969b2-8105-4e3f-901a-5fd2bcdb6dad tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:50.204465 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c0c969b2-8105-4e3f-901a-5fd2bcdb6dad tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:50.577939 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c0c969b2-8105-4e3f-901a-5fd2bcdb6dad tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:50.598886 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c0c969b2-8105-4e3f-901a-5fd2bcdb6dad tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1221 microversion: 2.1 time: 0.406903 Oct 14 03:07:50.600071 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 8/15] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:50 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1221 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:50.984207 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:50.984696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:50.985095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:50.985503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:50.986078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:51.069343 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:51.069859 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:51.070297 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:51.071027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:51.083869 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:51.087773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:51.181607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Getting quotas for project 5cd113c7d65543b2bac8ef368467c092. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:51.195428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Getting quotas for user 7517af640df3402783a38befbf3d3908 and project 5cd113c7d65543b2bac8ef368467c092. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:51.239785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:51.286191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:51.449310 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-595051472", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb28930e-3d0a-43c7-985a-b1d6573d124d"}], "security_groups": [{"name": "tempest-securitygroup--217555386"}], "key_name": "tempest-keypair-2065246945", "user_data": "}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:51.515993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-75751661-52ea-4e67-9332-66cccfd67570 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.903545 Oct 14 03:07:51.519080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 8/16] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 03:07:51.539582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0245c6d1-d8d6-4910-9a21-e783a0122ba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:51.542585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0245c6d1-d8d6-4910-9a21-e783a0122ba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:51.824322 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0245c6d1-d8d6-4910-9a21-e783a0122ba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:51.854348 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0245c6d1-d8d6-4910-9a21-e783a0122ba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1214 microversion: 2.1 time: 0.326265 Oct 14 03:07:51.854937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 9/17] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:51 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:51.884605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8cf244d4-3fb4-4d06-8211-467bd05427dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:51.885496 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8cf244d4-3fb4-4d06-8211-467bd05427dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:52.250693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] validate_networks() for [('bb28930e-3d0a-43c7-985a-b1d6573d124d', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:52.263122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8cf244d4-3fb4-4d06-8211-467bd05427dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:52.278061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8cf244d4-3fb4-4d06-8211-467bd05427dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1221 microversion: 2.1 time: 0.397512 Oct 14 03:07:52.280277 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 10/18] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:51 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1221 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:52.885898 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ea59400b-5570-40fb-a16f-219e504f7052 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:52.886633 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ea59400b-5570-40fb-a16f-219e504f7052 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:53.196323 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ea59400b-5570-40fb-a16f-219e504f7052 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:53.205869 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ea59400b-5570-40fb-a16f-219e504f7052 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1214 microversion: 2.1 time: 0.327963 Oct 14 03:07:53.210679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 11/19] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:52 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:07:53.261382 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1363959408", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc7d519e-6d73-4b0e-803b-556cfc3b6498"}], "security_groups": [{"name": "tempest-securitygroup--314196786"}], "key_name": "tempest-keypair-1902552501", "user_data": "}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:53.811045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] validate_networks() for [('dc7d519e-6d73-4b0e-803b-556cfc3b6498', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:54.254605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:54.255102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:54.256263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:54.257123 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:54.257547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:54.281320 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:54.282896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:54.283349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:54.284092 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:54.284568 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:54.285060 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:54.314277 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for project 20fb24be77624e59b8560c7863ca4a46. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:54.318906 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for user 410b7c9e93c94ce78d1b5c0e646307a2 and project 20fb24be77624e59b8560c7863ca4a46. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:54.332413 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:54.336120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:54.612720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0e115ada-fd3d-463b-b26d-d287960e24b9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.170589 Oct 14 03:07:54.628366 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 9/20] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 3187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:07:54.650316 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:54.654963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:54.672433 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:54.673354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:54.674084 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:54.675021 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:54.675685 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:54.676446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:55.223794 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:55.262762 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-80170926-b1f4-45b7-9da1-f4fde899fc82 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1281 microversion: 2.1 time: 0.632347 Oct 14 03:07:55.285017 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 10/21] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:54 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1281 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:55.303325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1550199051", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "706c2be8-801d-4fd3-a7af-a476e6a9ec99"}], "security_groups": [{"name": "tempest-securitygroup--1167623173"}], "key_name": "tempest-keypair-19140152", "user_data": "}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:07:55.773363 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] validate_networks() for [('706c2be8-801d-4fd3-a7af-a476e6a9ec99', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:07:56.091777 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:56.092246 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:56.092977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:56.095612 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:56.097418 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:56.135903 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:56.195421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:56.195421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:56.195421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:56.195421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:56.198316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:56.198316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Getting quotas for project 55f278e0f09c45ca8ab33cd9e102446c. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:56.222093 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Getting quotas for user ab344e29f747423fb8766f2d8fbfef0b and project 55f278e0f09c45ca8ab33cd9e102446c. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:56.287774 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:56.317341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:56.760306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f4d1bfab-9d1b-4fdd-9446-9f966d4e9082 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.548244 Oct 14 03:07:56.763430 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 12/22] 10.222.0.39 () {62 vars in 1188 bytes} [Fri Oct 14 03:07:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 3552 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 14 03:07:56.778400 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:56.809567 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:07:56.811348 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:56.821049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:07:56.821049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:07:56.821049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:07:56.822007 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:07:56.843988 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:56.848984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:56.848984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:56.849971 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:56.851952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:56.855640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:56.856027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:56.856536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:56.856979 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:56.857698 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:56.858179 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:56.868498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:56.902615 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Getting quotas for project 5470d8ee28f74b4eb385a90c33a514b8. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:07:56.914306 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Getting quotas for user fb1c279c2f7f404ab9c846a3ba594886 and project 5470d8ee28f74b4eb385a90c33a514b8. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:07:56.956696 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:07:56.963787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:07:57.299876 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1f540850-0f82-49c0-b006-de3d44762388 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.011698 Oct 14 03:07:57.312522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 11/23] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:07:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:07:57.319709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:57.320451 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:57.337701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:57.338289 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:57.338764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:57.342566 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:57.343052 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:57.343486 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:57.821894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:57.841500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-978f84e6-b578-4660-80af-7a6f329424f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1245 microversion: 2.1 time: 0.527863 Oct 14 03:07:57.848353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:57.859618 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:57 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1245 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:57.873736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:57.876172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a82b3d68-eb0d-43ac-a8b6-043c0afcc247 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1274 microversion: 2.1 time: 1.109870 Oct 14 03:07:57.879258 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:57.885217 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:56 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1274 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:57.909940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:57.922918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:57.924635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-33601ded-1d0c-482a-879a-a9eaeab7229c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:57.925272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:57.928327 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-33601ded-1d0c-482a-879a-a9eaeab7229c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:57.929376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:57.932332 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:57.932991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:58.113868 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-33601ded-1d0c-482a-879a-a9eaeab7229c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:58.144847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-33601ded-1d0c-482a-879a-a9eaeab7229c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:58.152020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-33601ded-1d0c-482a-879a-a9eaeab7229c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:58.171322 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-33601ded-1d0c-482a-879a-a9eaeab7229c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1282 microversion: 2.20 time: 0.269976 Oct 14 03:07:58.172064 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 14/26] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:07:57 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1282 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:07:58.207829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1f7f4874-5855-4420-b070-85fa0e0adb54 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:58.213748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1f7f4874-5855-4420-b070-85fa0e0adb54 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:58.225075 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:58.241183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b354fb90-88e9-4d62-b251-8e7956cda49a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1279 microversion: 2.1 time: 0.379359 Oct 14 03:07:58.262214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 13/27] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:57 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1279 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:58.356141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1f7f4874-5855-4420-b070-85fa0e0adb54 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:58.365236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1f7f4874-5855-4420-b070-85fa0e0adb54 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1236 microversion: 2.1 time: 0.184765 Oct 14 03:07:58.365848 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 15/28] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:58 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1236 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:58.883545 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:58.884692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:58.892316 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:58.892807 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:58.893242 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:58.893985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:58.894454 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:58.894878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:58.921276 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:58.924082 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:58.932203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:58.933045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:58.933718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:58.936823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:58.937618 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:58.938235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.143833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.148637 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.156605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-35e91122-d57d-4c09-97b6-43b3a00c802a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1293 microversion: 2.1 time: 0.275300 Oct 14 03:07:59.158010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 14/29] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:58 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1293 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:07:59.172271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0deef0ab-89cc-4f7d-9234-d653e4c46644 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1272 microversion: 2.1 time: 0.264110 Oct 14 03:07:59.179273 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 16/30] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:58 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1272 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:59.203330 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:59.203330 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:59.231818 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:59.236898 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:59.238705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.239699 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:59.243080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:59.243653 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.268753 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:59.270337 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:59.285499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:59.286460 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:59.288309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.293090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:59.293993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:59.295913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.498317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.510062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.511908 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.517833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c58ab1a1-bc62-4d9f-ae4f-14d66b991617 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1286 microversion: 2.20 time: 0.316601 Oct 14 03:07:59.517833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 15/31] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:07:59 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1286 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:07:59.519363 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:07:59.520176 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:07:59.534747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:59.536383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:59.537283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.548754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:07:59.549366 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:07:59.549909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:07:59.691555 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.707269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3cf43fea-402e-4762-99a1-4f42d05edc11 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1240 microversion: 2.1 time: 0.190861 Oct 14 03:07:59.707269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 16/32] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:59 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1240 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:07:59.849031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:07:59.886608 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c685f288-7b9e-4294-bdab-da830152aee5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.620643 Oct 14 03:07:59.889364 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:07:59 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:00.181638 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:00.183056 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:00.193110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.195210 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.195811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.197224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.207534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:00.212353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:00.212587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.212674 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.223159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.223658 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.224112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.224817 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.225290 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.246808 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.511746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:00.532412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d345658f-ed0e-480d-9f32-dac60fe72ae7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1293 microversion: 2.1 time: 0.354373 Oct 14 03:08:00.533006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 17/34] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:00 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1293 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:00.553645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:00.554437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:00.580406 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.581069 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.581615 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.584546 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.585203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.586502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.839660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:00.866785 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:00.868399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:00.869590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2281a0fe-9310-4c41-a939-654ca2e3e2e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1278 microversion: 2.20 time: 0.328544 Oct 14 03:08:00.870179 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 18/35] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:00 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1278 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:00.888380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:00.905318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:00.912281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:00.917233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a6d5adf2-663a-4116-a8d5-93df05e9821a tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.713394 Oct 14 03:08:00.935933 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 18/36] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:00 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:00.960517 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.961332 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.962588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.963471 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:00.964258 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:00.964823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:00.969929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:00.970714 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:00.979962 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:01.019801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.020504 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.023280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.024860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.025672 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.026323 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.291235 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:01.299750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-451b657b-388b-4f89-9621-8f3aefbb1e89 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1288 microversion: 2.1 time: 0.417976 Oct 14 03:08:01.300328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 19/37] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:00 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1288 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:01.468816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-70c9e1c8-baa1-4933-869a-a85eb9c9e9f3 req-418f80b5-8caa-48d0-bcf9-323b61e1e7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d96e4d-ef17-461e-a4f4-ee55452c0223", "tag": "8c75b196-f33a-4b89-b5fd-abf20f10fb84"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:01.489549 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-70c9e1c8-baa1-4933-869a-a85eb9c9e9f3 req-418f80b5-8caa-48d0-bcf9-323b61e1e7b3 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.491357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-70c9e1c8-baa1-4933-869a-a85eb9c9e9f3 req-418f80b5-8caa-48d0-bcf9-323b61e1e7b3 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.493428 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-70c9e1c8-baa1-4933-869a-a85eb9c9e9f3 req-418f80b5-8caa-48d0-bcf9-323b61e1e7b3 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.529302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-70c9e1c8-baa1-4933-869a-a85eb9c9e9f3 req-418f80b5-8caa-48d0-bcf9-323b61e1e7b3 service nova] Creating event network-changed:8c75b196-f33a-4b89-b5fd-abf20f10fb84 for instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 on hv-cinder-80152 Oct 14 03:08:01.530367 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-70c9e1c8-baa1-4933-869a-a85eb9c9e9f3 req-418f80b5-8caa-48d0-bcf9-323b61e1e7b3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119283) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 14 03:08:01.532692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-70c9e1c8-baa1-4933-869a-a85eb9c9e9f3 req-418f80b5-8caa-48d0-bcf9-323b61e1e7b3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119283) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 14 03:08:01.534093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.534712 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.535740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.536377 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.537006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.537645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.548776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.compute.rpcapi [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 14 03:08:01.550034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=119283) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 14 03:08:01.569030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-112f6c79-1590-4571-812d-9d720ce492b6 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264943 Oct 14 03:08:01.570235 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 20/38] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:01.578560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:01.581927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:01.589291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.590019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.590717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.591623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.592409 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.593034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.619317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:01.628761 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-dc0a0f65-a5d6-4b6f-8ed5-85b115ec129c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.690156 Oct 14 03:08:01.642440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 19/39] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:00 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:01.686265 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:01.695148 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7f0d65f2-f4b2-43d7-8d2c-082895d31a36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1299 microversion: 2.1 time: 0.122739 Oct 14 03:08:01.698934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 21/40] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:01 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:01.896852 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:01.897615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:01.908623 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.909380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.913208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.913208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.913208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.913208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.944493 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:01.945439 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:01.953743 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:01.961250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.963887 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.965533 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:01.966581 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:01.968577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:01.970520 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:02.083075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:02.092656 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:02.100084 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:02.101040 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fd918760-01c6-4f53-b0ad-2e485ca4504b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1278 microversion: 2.20 time: 0.208535 Oct 14 03:08:02.101629 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:01 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:02.326473 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:02.327389 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:02.341549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:02.344488 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:02.346096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:02.349243 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:02.350114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:02.351806 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:02.437421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:02.445780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9da3dc4e-c85c-403e-9ff2-979d8243f3a7 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.505787 Oct 14 03:08:02.449281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 22/42] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:01 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:02.553796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:02.566091 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8b5bd803-26c6-4cd9-a523-17958667a9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1288 microversion: 2.1 time: 0.241831 Oct 14 03:08:02.567897 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 21/43] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:02 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1288 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:02.657039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:02.658074 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:02.666109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:02.667147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:02.667789 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:02.668766 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:02.669494 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:02.670155 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:02.724827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:02.734451 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:02.745871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:02.751219 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:02.751912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:02.752988 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:02.756268 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:02.757110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:03.251702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:03.260768 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d4532373-801d-4cff-add1-04da1559be71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1299 microversion: 2.1 time: 0.540630 Oct 14 03:08:03.278405 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 22/44] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:02 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1299 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:03.291000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:03.294328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:03.320318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:03.321217 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:03.322267 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:03.326718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:03.327492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:03.329111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:03.737690 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:03.747311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ceadfc2e-4e20-41cd-9dc0-159250435f7e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 1.097004 Oct 14 03:08:03.747905 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 23/45] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:02 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:03.766770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:03.767558 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:03.777971 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:03.783239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:03.784673 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:03.785607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:03.786256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:03.786960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:03.929462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:03.947834 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:03.950232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:03.951386 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6c35e961-1574-46cd-b6b6-0ce13b58234f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1334 microversion: 2.20 time: 0.671540 Oct 14 03:08:03.962421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:03 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1334 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:03.967192 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:03.967814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:04.019272 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.025643 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.026433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.027180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.032862 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.033369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.266758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:04.277857 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c56251fa-2b71-4556-9876-f4c042f45be7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1294 microversion: 2.1 time: 0.314212 Oct 14 03:08:04.302255 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 24/47] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:03 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1294 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:04.430607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-eb6fb49e-b2e5-4f4d-ab16-0af16f26d119 req-4cd7e499-643b-40af-8b3e-0bbdbcd70752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706d7731-fcb4-4570-be80-854614a86150", "tag": "c9eaee60-8415-4f9b-89cb-7e16d1dd5b4f"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:04.448458 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:04.456272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6a594b3b-35fb-431f-b3df-7f0120a77f1b tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.705287 Oct 14 03:08:04.484773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-eb6fb49e-b2e5-4f4d-ab16-0af16f26d119 req-4cd7e499-643b-40af-8b3e-0bbdbcd70752 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.490308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:03 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:04.490862 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-eb6fb49e-b2e5-4f4d-ab16-0af16f26d119 req-4cd7e499-643b-40af-8b3e-0bbdbcd70752 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.490862 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-eb6fb49e-b2e5-4f4d-ab16-0af16f26d119 req-4cd7e499-643b-40af-8b3e-0bbdbcd70752 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.491019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-93c9b6c4-2025-469c-9494-dac67a02f681 req-c33298a4-eb8d-4baf-a1d9-0b81687480aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2de16b-159b-4d0a-8830-7c37d2c16d63", "tag": "85b7ee5a-21b7-45b0-9d95-c8b510e07a5f"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:04.508091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-93c9b6c4-2025-469c-9494-dac67a02f681 req-c33298a4-eb8d-4baf-a1d9-0b81687480aa service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.509029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-93c9b6c4-2025-469c-9494-dac67a02f681 req-c33298a4-eb8d-4baf-a1d9-0b81687480aa service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.509720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-93c9b6c4-2025-469c-9494-dac67a02f681 req-c33298a4-eb8d-4baf-a1d9-0b81687480aa service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.530895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-93c9b6c4-2025-469c-9494-dac67a02f681 req-c33298a4-eb8d-4baf-a1d9-0b81687480aa service nova] Creating event network-changed:85b7ee5a-21b7-45b0-9d95-c8b510e07a5f for instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 on hv-cinder-80152 Oct 14 03:08:04.531000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-eb6fb49e-b2e5-4f4d-ab16-0af16f26d119 req-4cd7e499-643b-40af-8b3e-0bbdbcd70752 service nova] Creating event network-changed:c9eaee60-8415-4f9b-89cb-7e16d1dd5b4f for instance 706d7731-fcb4-4570-be80-854614a86150 on hv-cinder-80152 Oct 14 03:08:04.531000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-eb6fb49e-b2e5-4f4d-ab16-0af16f26d119 req-4cd7e499-643b-40af-8b3e-0bbdbcd70752 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119284) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 14 03:08:04.531000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-eb6fb49e-b2e5-4f4d-ab16-0af16f26d119 req-4cd7e499-643b-40af-8b3e-0bbdbcd70752 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119284) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 14 03:08:04.531464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.531922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.532351 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.533064 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.533516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.533969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.547570 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-93c9b6c4-2025-469c-9494-dac67a02f681 req-c33298a4-eb8d-4baf-a1d9-0b81687480aa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067634 Oct 14 03:08:04.548181 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 25/49] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:04.553210 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:04.553946 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:04.565336 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.compute.rpcapi [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 14 03:08:04.565336 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] Releasing lock "compute-rpcapi-router" {{(pid=119284) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 14 03:08:04.567711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.568207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.568643 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.569393 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.569877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.570301 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.585462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fcafad49-230c-47ed-b364-90b67e626cf2 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295203 Oct 14 03:08:04.586104 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 25/50] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:04.663863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:04.677596 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-70ba3461-2832-49c8-8626-22e23f8bc9e9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1299 microversion: 2.1 time: 0.128170 Oct 14 03:08:04.678457 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 26/51] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:04 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:04.770468 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:04.771349 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:04.778284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.778901 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.779443 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.780261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:04.780923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:04.781385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:04.938242 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:04.950196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bfccee1d-b5bc-4598-8d9d-9a67ea30f459 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.183954 Oct 14 03:08:04.966469 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 26/52] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:04 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:04.994209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:04.995445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:05.001617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.006237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.007254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.009347 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.011141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.011905 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.022842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:05.139875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.149557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.151079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.152238 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-dda95232-7163-4c27-9c6c-413d445c6980 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1334 microversion: 2.20 time: 0.162904 Oct 14 03:08:05.154670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 27/53] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:04 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1334 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:05.314128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:05.317254 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:05.325365 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.326372 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.326954 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.328600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.329268 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.329918 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.418410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.426960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ad9124da-64a9-4cf1-8560-f82eab293dbc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1294 microversion: 2.1 time: 0.118234 Oct 14 03:08:05.427543 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 27/54] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:05 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:05.487881 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:05.488737 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:05.496750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.497270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.497706 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.498438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.499031 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.499464 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.688400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.698074 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cbe8795a-def6-4398-9709-7aa401424317 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.215286 Oct 14 03:08:05.698654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 28/55] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:05 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:05.700678 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:05.701492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:05.717306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.717823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.721881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.723975 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.724653 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.725352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.925206 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:05.944119 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-49eac599-1a8f-442a-b1c6-ebc63c9c807a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.246557 Oct 14 03:08:05.944925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 28/56] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:05 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:05.975391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:05.976227 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:05.984821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.985346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.985823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:05.986574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:05.987285 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:05.987717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.156473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.165039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fd07c098-e1b8-4e86-9241-ca03728dc905 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.194960 Oct 14 03:08:06.165604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 29/57] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:05 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:06.176969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:06.178721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:06.184984 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.185670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.186133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.186930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.187392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.187810 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.253478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.262244 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.263703 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.264847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-939b6068-c6d3-484f-8a0f-adedcd03f724 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1334 microversion: 2.20 time: 0.092193 Oct 14 03:08:06.265406 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 29/58] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:06 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:06.451112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:06.451848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:06.457776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.458260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.458692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.459396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.459886 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.460306 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.590491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.598057 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4efeec4e-1901-4b85-9585-146a74064c61 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.150983 Oct 14 03:08:06.598624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:06 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:06.722487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:06.723251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:06.729512 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.730069 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.730502 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.731230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.731682 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.732097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.903742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:06.911452 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8eba60bb-a036-4de0-8b55-1df8e671bde1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.194114 Oct 14 03:08:06.912022 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 30/60] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:06 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:06.970992 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:06.971610 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:06.974583 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=28 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:06.981475 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.981998 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.982434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:06.983149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:06.983576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:06.984254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.122918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.130490 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f2169319-ad62-48c8-be13-44ecfa866010 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.163682 Oct 14 03:08:07.131047 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 31/61] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:06 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:07.187330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:07.187941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:07.194983 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.195503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.195915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.196601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.197091 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.197935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.202116 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:07.292425 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:07.293654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:07.301477 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.302544 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.303291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.304284 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.305138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.305742 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.346868 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.358358 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ab719363-ffe0-4608-95b5-02892c0cd27f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.174693 Oct 14 03:08:07.359264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 31/62] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:07 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:07.382705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.391827 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.393567 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.394967 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e68e9c80-4fc5-48d2-a5e3-77646a938972 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1334 microversion: 2.20 time: 0.107398 Oct 14 03:08:07.409782 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 32/63] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:07 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1334 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:07.622069 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:07.622721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:07.632451 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.635487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.635963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.638310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.639707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.641244 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.896229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:07.918702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4e685e74-410c-43b3-ad4a-41d5563e32c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.297692 Oct 14 03:08:07.930845 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 32/64] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:07 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:07.935249 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:07.936207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:07.948494 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.949022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.949449 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:07.958107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:07.958611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:07.959046 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.134634 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.152481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-781d8e69-7b31-4e5e-9a2f-d7017c48d1eb tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.220709 Oct 14 03:08:08.153526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 33/65] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:07 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:08.169845 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:08.169845 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:08.169845 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.170177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.172378 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.173262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.174309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.179175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.332906 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.340966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0ff26577-80dc-4928-a53f-56da6f7dc948 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.188591 Oct 14 03:08:08.341545 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 33/66] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:08 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:08.382674 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:08.384129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:08.394575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.398464 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.398949 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.399729 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.400188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.400606 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.421235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:08.421814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:08.423631 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=34 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:08.429331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.430642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.431225 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.432133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.432581 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.432996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.540271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.550524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.552966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.554367 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-01436c65-bad9-4f4e-966d-654e711c961c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1334 microversion: 2.20 time: 0.137298 Oct 14 03:08:08.556004 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:08 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1334 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:08.605309 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:08.612993 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6bb60aaa-e6fc-4b41-87b9-6652751727e0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.234397 Oct 14 03:08:08.613554 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 34/68] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:08 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:08.951776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:08.953091 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:08.960787 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.963042 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.964336 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:08.965503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:08.966973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:08.968461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.181564 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:09.182734 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:09.195111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.196011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.196885 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.197839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.198641 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.199230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.214544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.231560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5075bfa1-f828-47d4-819b-78def81d5cfa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.290407 Oct 14 03:08:09.234975 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 35/69] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:08 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:09.364909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:09.365658 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:09.373131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.373977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.374582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.375431 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.376113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.376708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.418147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.426819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8c28748a-630b-46f6-b78e-6874c4c42a2c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.252024 Oct 14 03:08:09.428233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 35/70] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:09 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:09.579550 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:09.580168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:09.603736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.604266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.605863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.606589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.607056 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.607484 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.681564 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.694163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-dca88c43-5af7-446c-8238-a78eda95aa3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.333207 Oct 14 03:08:09.694774 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 36/71] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:09 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:09.714961 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:09.715574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:09.724162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.725292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.725943 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.727100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:09.727565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:09.727991 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:09.759047 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.769127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.777136 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.781655 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-17ed57a2-ef06-4ec6-b545-9f66edee3b53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1334 microversion: 2.20 time: 0.205819 Oct 14 03:08:09.782762 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:09 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1334 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:09.908549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:09.915432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7aa38678-6585-4dae-a1b1-b4e3a30907ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.203642 Oct 14 03:08:09.915738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 37/73] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:09 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:10.262719 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:10.263328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:10.270302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.270928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.271309 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.272065 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.272509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.272956 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.440122 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:10.447703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-35ee6ad7-b409-4cb9-ad7c-2b1d4ebff703 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.188757 Oct 14 03:08:10.448256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 37/74] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:10 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:10.450284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:10.450901 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:10.456805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.457360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.457823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.458517 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.458971 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.459502 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.634216 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:10.643124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a69fa470-2b74-42b0-965d-4e4c7cdea8b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.196672 Oct 14 03:08:10.643755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 38/75] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:10 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:10.717993 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:10.718897 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:10.727438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.728195 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.728858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.729785 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.730437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.731033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.805935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:10.806475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:10.815141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.815648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.816090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.816795 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.817246 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.817661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.926944 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:10.927341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:10.935168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-26d773ea-1e3a-4da1-bd9b-dfc73eb26175 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.221243 Oct 14 03:08:10.938961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 38/76] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:10 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:10.943703 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:10.944430 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:10.945047 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:10.947768 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:10.949280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5b59367b-37cc-4cf1-997e-3237efb4da5c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1342 microversion: 2.20 time: 0.147443 Oct 14 03:08:10.951800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.952496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.953103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.954053 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:10.954669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:10.955103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:10.966392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 39/77] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:10 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:11.470282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:11.471721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:11.477829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.478693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.479330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.480182 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.480780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.481338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.545284 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=10 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:11.607805 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.616234 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-656d6550-a50a-4377-9043-d021a262a33a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.675771 Oct 14 03:08:11.617207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 39/78] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:10 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:11.670126 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:11.670908 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:11.692823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.706850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.706850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.706850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.706850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.707333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.815425 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.826145 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-86e5394e-ad5c-4d44-ba09-23dc5e9761d6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.359609 Oct 14 03:08:11.826926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 40/79] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:11 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:11.891817 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:11.909998 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-dbd28757-239c-461e-82f4-feba28aa2f52 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.244838 Oct 14 03:08:11.921780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 40/80] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:11 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:11.961994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:11.962806 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:11.970565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.971048 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.971474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.972162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.972603 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.973020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.984129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:11.985027 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:11.991012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.991747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.992178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:11.993392 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:11.993861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:11.994276 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.104695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.113828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.115390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.116720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e31d10cb-bbcc-484e-a6fd-3e59156d2f95 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1340 microversion: 2.20 time: 0.136437 Oct 14 03:08:12.118377 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 41/81] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:11 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1340 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:12.204468 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:12.212678 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-83eb9822-dc39-49e5-807e-4b8f111ab7c4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.254977 Oct 14 03:08:12.227741 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 41/82] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:11 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:12.488762 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-7a5a56ab-0738-4b96-8b4f-8181b2de3ec4 req-d094800e-6e13-40b5-98ce-c25fe911c0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258e7a24-1f44-4662-b9b0-4f35c319a2d2", "tag": "071c08ed-047d-41ca-80e6-701785e75787"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:12.499107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-7a5a56ab-0738-4b96-8b4f-8181b2de3ec4 req-d094800e-6e13-40b5-98ce-c25fe911c0b1 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.499687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-7a5a56ab-0738-4b96-8b4f-8181b2de3ec4 req-d094800e-6e13-40b5-98ce-c25fe911c0b1 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.500213 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-7a5a56ab-0738-4b96-8b4f-8181b2de3ec4 req-d094800e-6e13-40b5-98ce-c25fe911c0b1 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.511276 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-7a5a56ab-0738-4b96-8b4f-8181b2de3ec4 req-d094800e-6e13-40b5-98ce-c25fe911c0b1 service nova] Creating event network-changed:071c08ed-047d-41ca-80e6-701785e75787 for instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 on hv-cinder-80152 Oct 14 03:08:12.517607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-7a5a56ab-0738-4b96-8b4f-8181b2de3ec4 req-d094800e-6e13-40b5-98ce-c25fe911c0b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032496 Oct 14 03:08:12.517607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 42/83] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:12.640197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:12.640813 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:12.646965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.647548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.647869 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.649472 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.649963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.650387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.862193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:12.864933 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:12.887452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.888475 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.888580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:12.889606 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:12.890319 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:12.895636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.062557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.073102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-35a4d30a-8963-4b1b-b1eb-bcc3c99d37ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.436916 Oct 14 03:08:13.074010 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 42/84] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:12 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:13.092894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:13.094158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:13.105844 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.108126 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.109103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.111055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.112519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.113161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.181862 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.200296 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2f5185cd-6d18-408a-9de6-7341b2945ce1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.349586 Oct 14 03:08:13.200896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 43/85] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:12 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:13.205605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:13.206239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:13.213920 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.214691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.215306 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.216196 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.216825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.217508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.267030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:13.343071 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.351219 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.361029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d12c19ce-3112-46bf-b0e7-e244adf98952 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.285570 Oct 14 03:08:13.362220 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 43/86] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:13 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:13.365675 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.369244 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:13.369378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.371556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:13.372847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0a2b4dbd-354a-42a9-84d1-4c456dd66c34 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1340 microversion: 2.20 time: 0.169450 Oct 14 03:08:13.375879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 44/87] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:13 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1340 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:13.400583 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.400583 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.400583 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.400583 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:13.400915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:13.400915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:13.614759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:13.630822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-64231eeb-0128-4fdf-84f0-e8de85e58f16 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.267116 Oct 14 03:08:13.631417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 44/88] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:13 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:14.107321 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:14.114559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:14.123967 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.124462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.124895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.130460 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.131883 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.132374 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.223768 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:14.224988 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:14.241653 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.242798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.243259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.244671 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.245076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.245506 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.544221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=6 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:14.909067 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:14.930540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3f900155-15ad-48c6-8fd1-07a4672f1507 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.830277 Oct 14 03:08:14.931178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 45/89] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:14 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:14.938338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:14.942019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:14.946081 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:14.953484 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b9141c0a-c978-43c0-8804-452c9b7123d0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.733856 Oct 14 03:08:14.954103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 45/90] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:14 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:14.970419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.970419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.970419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.970419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.970770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.970770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:14.970989 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:14.970989 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:14.995287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:14.997659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:14.998287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.000586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.001187 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.003647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.298188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.354066 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-46e17978-996e-4cbf-8a8b-bfb065425472 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.384338 Oct 14 03:08:15.354066 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 46/91] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:14 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:15.354066 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-9a6d8ae8-c726-4be5-8ec7-a914d8694186 req-273e1373-b3c0-4b4a-bea4-0b26ef65f032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73287e1d-7bf7-4ebb-93e4-7e16bd29655e", "tag": "19709406-415e-437a-9a30-3eb561347116"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:15.354066 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-9a6d8ae8-c726-4be5-8ec7-a914d8694186 req-273e1373-b3c0-4b4a-bea4-0b26ef65f032 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.354678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-9a6d8ae8-c726-4be5-8ec7-a914d8694186 req-273e1373-b3c0-4b4a-bea4-0b26ef65f032 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.354678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-9a6d8ae8-c726-4be5-8ec7-a914d8694186 req-273e1373-b3c0-4b4a-bea4-0b26ef65f032 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.384604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-9a6d8ae8-c726-4be5-8ec7-a914d8694186 req-273e1373-b3c0-4b4a-bea4-0b26ef65f032 service nova] Creating event network-changed:19709406-415e-437a-9a30-3eb561347116 for instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e on hv-cinder-80152 Oct 14 03:08:15.398531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-9a6d8ae8-c726-4be5-8ec7-a914d8694186 req-273e1373-b3c0-4b4a-bea4-0b26ef65f032 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071064 Oct 14 03:08:15.398531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 47/92] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:15.405770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:15.406479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:15.432094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.432991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.432991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.433698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.434172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.434590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.724684 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.752342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.755870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.757394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1c0f6043-07fd-4ef7-9bd6-91d602b4b6de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.802352 Oct 14 03:08:15.759717 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 46/93] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:14 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:15.822738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:15.833945 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-07eeb12d-e29e-457a-b84b-57a262ab7381 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.441973 Oct 14 03:08:15.835245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 48/94] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:15 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:15.954360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:15.955708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:15.967821 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.969371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.970229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.973288 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.975269 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.975897 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.988003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:15.988618 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:15.997812 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:15.998363 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:15.998977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:15.999680 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.000281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.000891 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.249602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:16.255165 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:16.265331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cde80a3d-7423-480d-828e-a33e92e686cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.314916 Oct 14 03:08:16.279497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 47/95] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:15 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:16.326830 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:16.339342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1182abc8-7597-40c6-a4cb-e9ec5aa5c040 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.355459 Oct 14 03:08:16.339985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 49/96] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:15 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:16.380082 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:16.380663 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:16.395524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.395524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.395524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.395524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.395866 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.395866 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.598651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:16.612965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a091a2f3-2b45-43b7-a749-3ff864c576f1 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.235700 Oct 14 03:08:16.639135 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 48/97] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:16 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:16.681088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-09c17e7e-c492-4dda-b212-531f3e47a313 req-4bd2d095-8010-4363-8499-795f2f09c2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d96e4d-ef17-461e-a4f4-ee55452c0223", "name": "network-vif-plugged", "status": "completed", "tag": "8c75b196-f33a-4b89-b5fd-abf20f10fb84"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:16.692937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-09c17e7e-c492-4dda-b212-531f3e47a313 req-4bd2d095-8010-4363-8499-795f2f09c2c7 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.694198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-09c17e7e-c492-4dda-b212-531f3e47a313 req-4bd2d095-8010-4363-8499-795f2f09c2c7 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.695042 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-09c17e7e-c492-4dda-b212-531f3e47a313 req-4bd2d095-8010-4363-8499-795f2f09c2c7 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.708239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-09c17e7e-c492-4dda-b212-531f3e47a313 req-4bd2d095-8010-4363-8499-795f2f09c2c7 service nova] Creating event network-vif-plugged:8c75b196-f33a-4b89-b5fd-abf20f10fb84 for instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 on hv-cinder-80152 Oct 14 03:08:16.714284 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-09c17e7e-c492-4dda-b212-531f3e47a313 req-4bd2d095-8010-4363-8499-795f2f09c2c7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141909 Oct 14 03:08:16.715446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 50/98] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:16.787533 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:16.788211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:16.794484 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.795086 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.795647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.796399 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.796920 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.797411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.858283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:16.859248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:16.866770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.867327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.868099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.868964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:16.869425 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:16.870368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:16.995043 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.004034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.005477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.006822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5fdae4f6-7b13-4f6a-ae18-8451d7a40f80 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.223133 Oct 14 03:08:17.007380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 49/99] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:16 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:17.050577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.059375 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4231706a-6c68-432f-9b00-263edb0161bf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.205529 Oct 14 03:08:17.059981 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 51/100] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:16 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:17.288820 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:17.289433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:17.295435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.295910 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.296345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.297027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.297480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.297931 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.373009 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:17.374318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:17.383209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.384214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.384799 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.385998 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.387069 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.387902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.475547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.484270 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-931c3c20-bbf8-4239-ac27-99d577adba49 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.199250 Oct 14 03:08:17.484806 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 50/101] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:17 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:17.591030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.599208 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-da656742-4445-4a5b-abc4-c47a85341189 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.238161 Oct 14 03:08:17.607369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 52/102] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:17 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:17.635108 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-773c81c3-990b-420d-9bde-aac2228ba794 req-83d25117-5112-445c-99c8-53ed16a7b215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95dafdb-f3bf-4f25-96bc-6595e7f52a89", "tag": "e18b99a9-f003-40de-a7b1-30cc36ffa681"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:17.646303 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:17.647187 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:17.654076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-773c81c3-990b-420d-9bde-aac2228ba794 req-83d25117-5112-445c-99c8-53ed16a7b215 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.654558 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-773c81c3-990b-420d-9bde-aac2228ba794 req-83d25117-5112-445c-99c8-53ed16a7b215 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.654987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-773c81c3-990b-420d-9bde-aac2228ba794 req-83d25117-5112-445c-99c8-53ed16a7b215 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.662112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.662801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.663378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.667627 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:17.667627 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:17.667627 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:17.678237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-773c81c3-990b-420d-9bde-aac2228ba794 req-83d25117-5112-445c-99c8-53ed16a7b215 service nova] Creating event network-changed:e18b99a9-f003-40de-a7b1-30cc36ffa681 for instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 on hv-cinder-80152 Oct 14 03:08:17.684488 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-773c81c3-990b-420d-9bde-aac2228ba794 req-83d25117-5112-445c-99c8-53ed16a7b215 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054887 Oct 14 03:08:17.685131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 51/103] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:08:17.821831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:17.830193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3592c7d7-a9f9-4b55-9aab-abcf273cfc9c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.187814 Oct 14 03:08:17.830818 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 53/104] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:17 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:18.032479 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.033279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.040074 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.040571 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.040997 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.041678 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.042152 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.042563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.082891 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.083523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.095628 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.096124 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.096580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.097267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.097785 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.098164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.267218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.276263 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.277697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.278871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0cb41a4f-8b6f-4f19-9c69-85ff0c021a17 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.250704 Oct 14 03:08:18.279435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 52/105] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:18.296576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.303035 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d6a08c34-84dd-47ba-9604-d7e0c1cea862 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.224678 Oct 14 03:08:18.303599 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 54/106] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:18.512083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.512687 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.518891 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.519366 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.520127 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.520680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.521531 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.522174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.637940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.637940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.642872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.644353 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.645139 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.646092 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.647315 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.647938 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.661117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.670757 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-78f65533-de26-48b5-8dc3-b101761d86a9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.163182 Oct 14 03:08:18.672872 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 53/107] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:18.736700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-6de5c925-be47-41bb-a65c-055e69d2249a req-a8feda05-aa03-4e5a-885b-97a32b0da729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706d7731-fcb4-4570-be80-854614a86150", "name": "network-vif-plugged", "status": "completed", "tag": "c9eaee60-8415-4f9b-89cb-7e16d1dd5b4f"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:18.755009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-6de5c925-be47-41bb-a65c-055e69d2249a req-a8feda05-aa03-4e5a-885b-97a32b0da729 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.755702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-6de5c925-be47-41bb-a65c-055e69d2249a req-a8feda05-aa03-4e5a-885b-97a32b0da729 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.756176 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-6de5c925-be47-41bb-a65c-055e69d2249a req-a8feda05-aa03-4e5a-885b-97a32b0da729 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.770935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-6de5c925-be47-41bb-a65c-055e69d2249a req-a8feda05-aa03-4e5a-885b-97a32b0da729 service nova] Creating event network-vif-plugged:c9eaee60-8415-4f9b-89cb-7e16d1dd5b4f for instance 706d7731-fcb4-4570-be80-854614a86150 on hv-cinder-80152 Oct 14 03:08:18.777270 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-6de5c925-be47-41bb-a65c-055e69d2249a req-a8feda05-aa03-4e5a-885b-97a32b0da729 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045208 Oct 14 03:08:18.778198 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 54/108] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:18.854415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:18.855358 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:18.861751 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.862261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.862699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.863435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:18.863832 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:18.864250 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:18.868446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:18.876501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9ddd6346-9ebc-4385-a7aa-4ab3b2facfb2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.247804 Oct 14 03:08:18.877617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 55/109] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:19.040733 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.053240 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4664222e-76c6-4827-bca4-0ea4b3f930d2 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.203952 Oct 14 03:08:19.055241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 55/110] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:18 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:19.305489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:19.306002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:19.314285 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.319072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.319840 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.323806 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.326262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:19.326675 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.326875 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:19.327311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.343602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.344503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.345122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.347188 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.348187 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.353722 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.714798 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.728896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.734497 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.734734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.737504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c86b8a28-e54f-41c2-92fe-6cdddd9e0132 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.438005 Oct 14 03:08:19.741131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 56/111] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:19 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:19.753893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:19.755310 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:19.761262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4bb6da70-ab66-45e4-938c-11f7f7b8ad64 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.438800 Oct 14 03:08:19.762135 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 56/112] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:19 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:19.774263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.774263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.776064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.776822 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.777589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.778217 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.900770 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:19.901606 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:19.909472 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.910205 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.911056 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.911955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:19.912954 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:19.913619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:19.967925 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:19.984327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d1ac92a4-3603-42cf-9c58-6b5cbc5f0aeb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.235917 Oct 14 03:08:19.985103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 57/113] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:19 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:20.079500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:20.080222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:20.089866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.090839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.092033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.092846 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.093940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.094468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.105719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:20.115454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-45214dcf-62dc-4ae0-807d-081f4ba663f2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.219600 Oct 14 03:08:20.130178 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 57/114] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:19 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:20.235955 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:20.244120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a485e5b9-4e59-4e9e-a28c-9975f8ed3efa tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.170190 Oct 14 03:08:20.244621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 58/115] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:20 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:20.767413 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:20.768216 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:20.775427 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.775908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.780363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.780363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.780363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.780363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.792385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:20.793006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:20.804764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.810133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.810133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:20.810133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:20.810133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:20.810421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.009988 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.012316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.021878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.024156 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.025219 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6fee75cf-9996-4718-a30f-a0d33a62ba2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.236537 Oct 14 03:08:21.025527 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a345e688-bd74-4ea3-894b-b72e3ce68a2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.262497 Oct 14 03:08:21.026136 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 58/116] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:20 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:21.030558 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 59/117] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:20 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:21.034033 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:21.037605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:21.046256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.046741 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.047168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.047851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.048373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.048764 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.139474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:21.140222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:21.146539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.147019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.148154 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.151391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.151391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.151391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.185344 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.191628 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cf559e09-f1e6-43a6-903d-99a7726ee6b3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.164047 Oct 14 03:08:21.192740 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 59/118] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:21 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:21.267780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:21.268666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:21.276486 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.277265 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.277693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.278633 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:21.279237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:21.279659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:21.301262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.309280 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-43689073-5c25-4e44-8e2c-8f8011c6afa7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.173533 Oct 14 03:08:21.309977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 60/119] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:21 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:21.427204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:21.437094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-32e83411-ea28-47c5-9302-318a646d12ac tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.173804 Oct 14 03:08:21.438111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 60/120] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:21 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:22.048359 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.049185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.050512 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.051122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.056191 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.056600 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.057033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.057499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.058277 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.058582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.058774 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.058921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.059168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.060102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.060331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.060827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.250769 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.254365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.259311 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.260818 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.262065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9d5c652a-69d7-4c44-8c25-b62cc2dfbacc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.215275 Oct 14 03:08:22.262629 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 61/121] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:22.262750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-52733bbe-aded-4803-83f5-157b17363c8d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.218122 Oct 14 03:08:22.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 61/122] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:22.280566 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.281409 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.287452 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.287927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.288390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.289734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.293926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.293926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.336403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.337105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.343090 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.343820 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.344443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.345368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.346029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.346634 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.367442 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:22.487745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.513846 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-137adb1e-c591-44f3-9731-f9f1264c716a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.232399 Oct 14 03:08:22.513846 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 62/123] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:22.513846 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:22.513846 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:22.517099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.526631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e88efd7d-d717-4893-95da-c491760e2f9c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.194780 Oct 14 03:08:22.527356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 62/124] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:22.528017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.528638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.529230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.530084 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:22.530638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:22.531161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:22.694324 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:22.704196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b3fa7676-7a0f-435a-9524-e15dd19ed334 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.205827 Oct 14 03:08:22.705036 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 63/125] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:22 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:23.285943 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.287355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.288889 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.291266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.300808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.301749 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.304135 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.305658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.307891 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.308646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.313505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.314031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.315814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.318270 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.318760 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.319243 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.538440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.548106 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8301e00e-b9a4-480e-8c41-48f01b016aad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.267118 Oct 14 03:08:23.548783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 63/126] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:23.555473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.563263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.563263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.563263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.564006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.564795 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.564920 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.565578 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.566254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.581630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.585035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.585035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f4b0f663-35e9-43fc-8ff2-0752015e9069 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.301394 Oct 14 03:08:23.592142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 64/127] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:23.605745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.606382 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.615567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.616052 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.616530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.617804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.618413 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.618978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.806457 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.813298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:23.814579 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f44d0605-aa18-4e90-a742-197740602543 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.264077 Oct 14 03:08:23.825971 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 64/128] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:23.826114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:23.826208 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:23.826208 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:23.826359 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f541ed40-0666-4d59-8c2d-fb01c6b2de12 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.228462 Oct 14 03:08:23.826359 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 65/129] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:23.826522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.826522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.826917 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:23.827609 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:23.828061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:23.828483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.139031 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:24.146636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3eaf1b28-0953-4b51-85ef-550b5e0aac70 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1314 microversion: 2.1 time: 0.330536 Oct 14 03:08:24.147193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 65/130] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:23 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:24.583935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:24.584584 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:24.591238 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.591725 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.592156 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.592848 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.593366 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.593812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.611639 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:24.612473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:24.619284 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.619771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.620328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.621179 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.621644 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.622080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.778354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:24.787912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c8a51a1e-0527-483a-9bf6-79a46cb1abc6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.207746 Oct 14 03:08:24.788555 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 66/131] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:24 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:24.805452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:24.814058 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:24.815589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:24.816698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8b272416-a001-478d-b471-c1ae7de82aba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.209377 Oct 14 03:08:24.817797 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 66/132] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:24 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:24.839069 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:24.844428 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:24.845040 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:24.852759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.853470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.854180 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.855431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.856041 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.856661 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.871939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:24.921219 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.921739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.922200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:24.922901 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:24.941288 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:24.941453 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.088295 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.095956 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0b6d5ce7-0f9f-4439-9a54-b8bbdce528a7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.255505 Oct 14 03:08:25.096528 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 67/133] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:24 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:25.155812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.166191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-10c4e086-be8b-4fa7-9fcf-10f04769c305 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.328931 Oct 14 03:08:25.167218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 67/134] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:24 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:25.182781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:25.183604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:25.189612 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.190129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.190559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.191248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.191694 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.192134 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.330853 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:25.338932 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f37d9ed4-fecc-47b4-92e1-9e6240072c35 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1502 microversion: 2.1 time: 0.161200 Oct 14 03:08:25.339501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 68/135] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:25 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:25.514256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-a19b9d3d-52ea-4bf4-9583-d0ce5e970e57 req-eb6ec7c7-ee7c-4e31-ac61-e87b6cc2be90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258e7a24-1f44-4662-b9b0-4f35c319a2d2", "name": "network-vif-plugged", "status": "completed", "tag": "071c08ed-047d-41ca-80e6-701785e75787"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:25.526997 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-a19b9d3d-52ea-4bf4-9583-d0ce5e970e57 req-eb6ec7c7-ee7c-4e31-ac61-e87b6cc2be90 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.527729 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-a19b9d3d-52ea-4bf4-9583-d0ce5e970e57 req-eb6ec7c7-ee7c-4e31-ac61-e87b6cc2be90 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.528317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-a19b9d3d-52ea-4bf4-9583-d0ce5e970e57 req-eb6ec7c7-ee7c-4e31-ac61-e87b6cc2be90 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.541352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-a19b9d3d-52ea-4bf4-9583-d0ce5e970e57 req-eb6ec7c7-ee7c-4e31-ac61-e87b6cc2be90 service nova] Creating event network-vif-plugged:071c08ed-047d-41ca-80e6-701785e75787 for instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 on hv-cinder-80152 Oct 14 03:08:25.546452 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-a19b9d3d-52ea-4bf4-9583-d0ce5e970e57 req-eb6ec7c7-ee7c-4e31-ac61-e87b6cc2be90 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037232 Oct 14 03:08:25.547038 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 68/136] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:08:25.811193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:25.811806 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:25.818273 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.818753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.819185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.819870 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.820845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.821266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.842623 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:25.843324 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:25.846366 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:25.849887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.850375 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.850809 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:25.851501 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:25.851953 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:25.852375 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.033669 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.045432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.048881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.051350 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1ff10265-5e4f-453d-810a-dd0fb96e5669 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.212959 Oct 14 03:08:26.056672 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 69/137] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:25 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:26.102157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.110892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a45afecc-f3c4-4635-9c41-2d33469c8bef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.303676 Oct 14 03:08:26.120414 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:26.129896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:26.130043 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 69/138] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:25 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:26.130143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.130143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.130143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.130143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.130435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.130435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.192372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:26.192991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:26.200568 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.201070 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.201550 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.203223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:26.203714 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:26.204196 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:26.407196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.415258 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8866eb38-0d44-4574-8105-d94968b41700 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.299543 Oct 14 03:08:26.416107 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 70/139] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:26 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:26.432526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:26.440080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-af13d753-a012-44eb-9a1c-db7c5e382e91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.253145 Oct 14 03:08:26.440668 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 70/140] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:26 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:27.083159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:27.083789 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:27.089636 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.090154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.090589 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.091277 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.091734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.092193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.151736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:27.152351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:27.159139 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.159626 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.160060 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.160759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.161216 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.161636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.299473 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.310034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.311894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.313137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e6afbdec-2d85-48ab-880d-bb1a147310b6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.233857 Oct 14 03:08:27.325899 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 71/141] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:27 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:27.334809 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6674fa50-455e-4255-aad1-f4d3864169a5"}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:27.337307 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:27.343649 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.343885 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.344292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.344990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.345441 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.345891 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.381562 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.401121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f823a60a-91df-41f6-ad82-b6999fcae7a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.253254 Oct 14 03:08:27.402970 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 71/142] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:27 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:27.439118 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:27.439976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:27.446913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:27.449055 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.449964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.450754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.451843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.452311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.452985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.629787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.637440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fb4c3842-ada3-46c3-8cf1-75b37a0ef94d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1362 microversion: 2.1 time: 0.202246 Oct 14 03:08:27.641726 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 72/143] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:27 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:27.642444 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:27.643039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:27.649336 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.649978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.650474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.651231 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.651735 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.652349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.782680 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:27.791008 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8c4394d0-2807-406a-843b-57381e2a1811 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.151924 Oct 14 03:08:27.791521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 73/144] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:27 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:27.795873 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-95f2c366-c96a-4207-96be-e15006680b94 req-baa9a27c-e919-4380-ac73-8dbeb94ae836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73287e1d-7bf7-4ebb-93e4-7e16bd29655e", "name": "network-vif-plugged", "status": "completed", "tag": "19709406-415e-437a-9a30-3eb561347116"}, {"server_uuid": "8e2de16b-159b-4d0a-8830-7c37d2c16d63", "name": "network-vif-plugged", "status": "completed", "tag": "85b7ee5a-21b7-45b0-9d95-c8b510e07a5f"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:27.805711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-95f2c366-c96a-4207-96be-e15006680b94 req-baa9a27c-e919-4380-ac73-8dbeb94ae836 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:27.806207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-95f2c366-c96a-4207-96be-e15006680b94 req-baa9a27c-e919-4380-ac73-8dbeb94ae836 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:27.806626 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-95f2c366-c96a-4207-96be-e15006680b94 req-baa9a27c-e919-4380-ac73-8dbeb94ae836 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:27.818575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-95f2c366-c96a-4207-96be-e15006680b94 req-baa9a27c-e919-4380-ac73-8dbeb94ae836 service nova] Creating event network-vif-plugged:19709406-415e-437a-9a30-3eb561347116 for instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e on hv-cinder-80152 Oct 14 03:08:27.819067 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-95f2c366-c96a-4207-96be-e15006680b94 req-baa9a27c-e919-4380-ac73-8dbeb94ae836 service nova] Creating event network-vif-plugged:85b7ee5a-21b7-45b0-9d95-c8b510e07a5f for instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 on hv-cinder-80152 Oct 14 03:08:27.826075 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-95f2c366-c96a-4207-96be-e15006680b94 req-baa9a27c-e919-4380-ac73-8dbeb94ae836 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033422 Oct 14 03:08:27.826720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 74/145] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:28.343198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:28.346132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:28.357147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.358670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.359592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.360834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.362120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.364852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.511193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.519911 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.521332 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.522632 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e6d80fb5-c7d9-44a8-8078-19154f5d5e29 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.187496 Oct 14 03:08:28.523403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 75/146] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:28 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:08:28.527930 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:28.529152 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:28.534388 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.534910 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.535334 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.536009 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.536455 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.536870 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.708788 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.716964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0a91b5e4-9cd0-46c4-b6e6-f7c93961adc9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.192364 Oct 14 03:08:28.717672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 76/147] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:28 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:28.730543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:28.731356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:28.737623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.738140 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.738562 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.739239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:28.739748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:28.740166 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:28.974023 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:28.984146 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-db15d128-231b-41d6-b777-adbf759a20af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1548 microversion: 2.1 time: 0.265054 Oct 14 03:08:28.984909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 77/148] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:28 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1548 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:29.017499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:29.018499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:29.025196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0262d821-906e-42be-90dc-f22ee53b835c tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "POST /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.697713 Oct 14 03:08:29.028315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 72/149] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:08:27 2022] POST /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150/os-volume_attachments => generated 194 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:29.034824 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:29.035416 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:29.048558 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.049088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.049601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.050546 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.051102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.051523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.052957 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.053692 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.054374 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.055175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.055929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.056556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.246565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a429a7d7-1459-46c0-a894-8049dc414011 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.219160 Oct 14 03:08:29.266424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 73/150] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Oct 14 03:08:29 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:29.352509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:29.360281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ca4545e2-505f-4783-803a-760ccf2f2766 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.373934 Oct 14 03:08:29.360856 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 78/151] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:28 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:29.550183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:29.551099 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:29.559997 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.560722 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.562785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.563809 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.564527 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.565177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.740507 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:29.741499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:29.751631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.752333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.752960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.753869 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.755286 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.759504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:29.949401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:29.961012 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:29.967827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:29.969388 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c57ab94d-74a6-41cf-9060-0f56fbe4f814 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.423480 Oct 14 03:08:29.970508 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 74/152] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:29 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:29.976904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-07646567-1934-4642-8e2e-963dc345ff92 req-9d1ac97d-7206-479b-9703-e225a94211a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dafdb-f3bf-4f25-96bc-6595e7f52a89", "name": "network-vif-plugged", "status": "completed", "tag": "e18b99a9-f003-40de-a7b1-30cc36ffa681"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:29.994363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-07646567-1934-4642-8e2e-963dc345ff92 req-9d1ac97d-7206-479b-9703-e225a94211a4 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:29.995122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-07646567-1934-4642-8e2e-963dc345ff92 req-9d1ac97d-7206-479b-9703-e225a94211a4 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:29.995748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-07646567-1934-4642-8e2e-963dc345ff92 req-9d1ac97d-7206-479b-9703-e225a94211a4 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:30.011847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-07646567-1934-4642-8e2e-963dc345ff92 req-9d1ac97d-7206-479b-9703-e225a94211a4 service nova] Creating event network-vif-plugged:e18b99a9-f003-40de-a7b1-30cc36ffa681 for instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 on hv-cinder-80152 Oct 14 03:08:30.019549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-07646567-1934-4642-8e2e-963dc345ff92 req-9d1ac97d-7206-479b-9703-e225a94211a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047281 Oct 14 03:08:30.020782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 75/153] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:30.185987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:30.189380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:30.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-76e66308-d3c2-40cb-b41a-34b711bdad0b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1366 microversion: 2.1 time: 0.457345 Oct 14 03:08:30.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 79/154] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:29 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:30.385022 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:30.385903 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:30.392489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:30.393456 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:30.394147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:30.395291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:30.395802 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:30.396223 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:30.823714 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:30.834495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-040947de-1c41-40fb-a731-1a827c37fb99 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1321 microversion: 2.1 time: 0.454484 Oct 14 03:08:30.835387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 76/155] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:30 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:30.999230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:30.999837 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:31.012126 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.012844 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.013679 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.014828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.016429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.019731 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.143550 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-1721c16d-c6b6-4f2f-8085-39191e6d9786 req-1842f88b-1414-4330-9a01-f614e3a4af55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258e7a24-1f44-4662-b9b0-4f35c319a2d2", "tag": "071c08ed-047d-41ca-80e6-701785e75787"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:31.162009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1721c16d-c6b6-4f2f-8085-39191e6d9786 req-1842f88b-1414-4330-9a01-f614e3a4af55 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.162489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1721c16d-c6b6-4f2f-8085-39191e6d9786 req-1842f88b-1414-4330-9a01-f614e3a4af55 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.162914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1721c16d-c6b6-4f2f-8085-39191e6d9786 req-1842f88b-1414-4330-9a01-f614e3a4af55 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.185652 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-1721c16d-c6b6-4f2f-8085-39191e6d9786 req-1842f88b-1414-4330-9a01-f614e3a4af55 service nova] Creating event network-changed:071c08ed-047d-41ca-80e6-701785e75787 for instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 on hv-cinder-80152 Oct 14 03:08:31.217114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-1721c16d-c6b6-4f2f-8085-39191e6d9786 req-1842f88b-1414-4330-9a01-f614e3a4af55 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077098 Oct 14 03:08:31.219693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 77/156] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:31.229806 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:31.230321 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:31.253700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.264369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.264369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.264369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.264369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.264973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.281445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.297658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.297658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.297658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-48229106-13fa-4b14-b088-e4583b249fa9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.302321 Oct 14 03:08:31.298376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 80/157] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:30 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:31.411636 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:31.425950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-161eb723-15fb-4e60-8aa1-5582f68e5b7f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1555 microversion: 2.1 time: 0.203250 Oct 14 03:08:31.427587 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 78/158] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:31 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1555 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:31.451892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:31.452533 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:31.461218 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.462611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.463234 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.464160 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.465563 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.466190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.646717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-788c5117-222d-4ff9-8a8b-6199afa6716d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201320 Oct 14 03:08:31.647396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Oct 14 03:08:31 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:31.857698 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:31.859771 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:31.866635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.867128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.867594 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:31.868297 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:31.868745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:31.870537 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.170410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:32.193110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1208013b-7da8-4a55-ad1d-6ed04d0c26ea tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1514 microversion: 2.1 time: 0.338984 Oct 14 03:08:32.193643 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 79/160] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:31 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:32.236091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:32.240796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:32.266334 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.267141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.267775 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.268666 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.269273 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.269922 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.328019 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:32.330621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:32.352556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.355616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.356298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.358010 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.360885 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.362800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.367906 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lazy-loading 'flavor' on Instance uuid 8e2de16b-159b-4d0a-8830-7c37d2c16d63 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:08:32.586397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:32.599756 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:32.601853 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:32.603360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2c209c4f-c073-4dac-8570-966f97d52f05 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.284193 Oct 14 03:08:32.625867 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 80/161] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:32 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:32.878907 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-032a5a18-5347-46cf-9612-1e48fe002e93 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63/action" status: 200 len: 32 microversion: 2.1 time: 0.651506 Oct 14 03:08:32.881521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 82/162] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:08:32 2022] POST /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63/action => generated 32 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:08:32.891161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:32.891858 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:32.903389 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.904280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.905182 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:32.906666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:32.907304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:32.907961 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:33.081743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:33.090552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-42fb36f7-df45-40c8-ad79-35ecd070901e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.203937 Oct 14 03:08:33.091511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 81/163] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:32 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:33.631247 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:33.633805 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:33.650372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:33.650372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:33.650372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:33.650372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:33.650877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:33.650877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:33.864585 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:33.882579 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:33.885051 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:33.886404 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-07cb6000-4a8f-4666-8616-383dfc2b3185 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1407 microversion: 2.20 time: 0.261632 Oct 14 03:08:33.886963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 83/164] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:33 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:33.945100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-22106925-7264-4322-bb42-794f6a370720 req-4f18c474-d703-43e4-b3d5-68ef982facc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73287e1d-7bf7-4ebb-93e4-7e16bd29655e", "tag": "19709406-415e-437a-9a30-3eb561347116"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:33.955139 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-22106925-7264-4322-bb42-794f6a370720 req-4f18c474-d703-43e4-b3d5-68ef982facc2 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:33.955744 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-22106925-7264-4322-bb42-794f6a370720 req-4f18c474-d703-43e4-b3d5-68ef982facc2 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:33.956174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-22106925-7264-4322-bb42-794f6a370720 req-4f18c474-d703-43e4-b3d5-68ef982facc2 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:33.967856 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-22106925-7264-4322-bb42-794f6a370720 req-4f18c474-d703-43e4-b3d5-68ef982facc2 service nova] Creating event network-changed:19709406-415e-437a-9a30-3eb561347116 for instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e on hv-cinder-80152 Oct 14 03:08:33.974632 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-22106925-7264-4322-bb42-794f6a370720 req-4f18c474-d703-43e4-b3d5-68ef982facc2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033377 Oct 14 03:08:33.975275 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 82/165] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:08:34.115521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:34.116119 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:34.122986 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.123580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.124011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.124694 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.125137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.125552 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.285861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:34.295583 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1ef16ffd-fe3b-4517-9120-3ae5b722e0d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.184059 Oct 14 03:08:34.296432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 84/166] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:34 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:34.924252 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:34.925044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:34.940353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.941924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.947595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:34.948936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:34.949567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:34.950224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.289804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:35.303184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:35.305130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:35.306389 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d68ddb94-1d0a-422d-bb53-24d2bc5ba5af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1600 microversion: 2.20 time: 0.393967 Oct 14 03:08:35.307529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 83/167] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:08:34 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1600 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:08:35.318200 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:35.318711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:35.328877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.329593 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.330068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.330865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.331539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.332766 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.333524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:35.334435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:35.344167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.344732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.345377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.346390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:35.346911 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:35.347399 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:35.351977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:35.481906 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d7464b9e-6532-4682-a479-5e245b14a620 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.152811 Oct 14 03:08:35.483014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 84/168] 10.222.0.39 () {60 vars in 1316 bytes} [Fri Oct 14 03:08:35 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:08:35.727303 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:35.740322 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-84ca7c7d-5189-4ff9-9a7e-dbfe3e9fc9a7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.426096 Oct 14 03:08:35.757977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 85/169] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:35 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:36.769138 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:36.770013 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:36.778807 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:36.779298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:36.780047 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:36.781111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:36.781586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:36.782029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:37.036701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-3138f12b-4aad-4cbc-b8ed-0816a0b8b703 req-d9821284-996c-4fb8-9613-79f9c599a9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95dafdb-f3bf-4f25-96bc-6595e7f52a89", "tag": "e18b99a9-f003-40de-a7b1-30cc36ffa681"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:37.037923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:37.051777 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3241c17c-1081-4657-848f-258b33810482 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.287604 Oct 14 03:08:37.054698 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 85/170] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:36 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:37.057593 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-3138f12b-4aad-4cbc-b8ed-0816a0b8b703 req-d9821284-996c-4fb8-9613-79f9c599a9c9 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:37.058288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-3138f12b-4aad-4cbc-b8ed-0816a0b8b703 req-d9821284-996c-4fb8-9613-79f9c599a9c9 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:37.058869 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-3138f12b-4aad-4cbc-b8ed-0816a0b8b703 req-d9821284-996c-4fb8-9613-79f9c599a9c9 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:37.074290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-3138f12b-4aad-4cbc-b8ed-0816a0b8b703 req-d9821284-996c-4fb8-9613-79f9c599a9c9 service nova] Creating event network-changed:e18b99a9-f003-40de-a7b1-30cc36ffa681 for instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 on hv-cinder-80152 Oct 14 03:08:37.083993 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-3138f12b-4aad-4cbc-b8ed-0816a0b8b703 req-d9821284-996c-4fb8-9613-79f9c599a9c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065010 Oct 14 03:08:37.084936 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 86/171] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:38.080591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:38.084044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:38.090851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:38.091345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:38.091798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:38.092499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:38.092950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:38.093373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:38.246102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:38.254100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-02e0eebb-26da-4aa6-93e3-f4ffad7e323f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.180032 Oct 14 03:08:38.262448 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 86/172] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:38 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:39.278490 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:39.279191 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:39.285500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:39.286024 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:39.286461 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:39.287154 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:39.287607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:39.288548 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:39.455408 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:39.470110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-77ac4adb-be92-4d7e-8231-f01cc0a36c26 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.196047 Oct 14 03:08:39.470676 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 87/173] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:39 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:40.494887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:40.496076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:40.502870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:40.503349 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:40.505959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:40.505959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:40.505959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:40.505959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:40.691897 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:40.700680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9cb205a0-95ea-4bd3-bfb0-6ccd5cfe8955 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.210661 Oct 14 03:08:40.701731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 87/174] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:40 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:41.724385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:41.724385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:41.730914 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:41.731400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:41.731835 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:41.732532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:41.732981 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:41.733403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:41.880088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:41.889559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bc9a2080-7d45-4834-be90-7a672010e596 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.169776 Oct 14 03:08:41.901057 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 88/175] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:41 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:42.923522 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:42.924130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:42.930969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:42.931454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:42.934616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:42.934616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:42.934616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:42.934616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.107703 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:43.118917 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fa7af666-b814-414f-81cf-b2b903f775d5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.199096 Oct 14 03:08:43.119800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 88/176] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:42 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:43.170677 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1992374733", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "networks": [{"uuid": "6f9d2079-fec7-4a8b-b52a-3ca108fd76be"}]}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:43.226450 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] validate_networks() for [('6f9d2079-fec7-4a8b-b52a-3ca108fd76be', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:08:43.592150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:08:43.592574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:08:43.593043 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:08:43.593657 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:08:43.594116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:08:43.603407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.603914 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.604346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.605072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.605522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.606013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.624065 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Getting quotas for project 9e3dfb4977504552a5480cd375ded7dd. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:08:43.629586 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Getting quotas for user ced832cf86304814b020de4ed3e0955f and project 9e3dfb4977504552a5480cd375ded7dd. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:08:43.639597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:08:43.641980 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:08:43.774588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f54db752-d87a-4ccc-966e-afe8fb23995d tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607947 Oct 14 03:08:43.775339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 89/177] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:08:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:08:43.786581 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-df25931a-e749-40bb-8755-339e8d2ad8c4 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:43.787712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-df25931a-e749-40bb-8755-339e8d2ad8c4 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:43.874709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-df25931a-e749-40bb-8755-339e8d2ad8c4 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:43.883031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-df25931a-e749-40bb-8755-339e8d2ad8c4 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1219 microversion: 2.1 time: 0.100231 Oct 14 03:08:43.883863 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 89/178] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:43 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:43.892400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:43.892950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:43.899848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.900266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.900694 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.901378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:43.901851 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:43.902270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:43.929245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:08:44.142364 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:44.142987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:44.149553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:44.150059 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:44.150491 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:44.151198 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:44.151633 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:44.152267 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:44.217351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-28586cda-ab57-43cb-9c85-3a98ee0c152d tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "DELETE /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 204 len: 0 microversion: 2.1 time: 0.329594 Oct 14 03:08:44.218470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 90/179] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:08:43 2022] DELETE /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:08:44.230192 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:44.230192 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:44.236678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:44.237337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:44.237934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:44.238781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:44.239437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:44.239884 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:44.352272 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:44.361373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ecc50ef5-7032-462f-8b53-5b71521dd218 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.223125 Oct 14 03:08:44.361993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 90/180] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:44 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:44.416713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:44.425083 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-81e7d6d1-c18d-4225-8328-59e98899b4b4 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1554 microversion: 2.1 time: 0.202535 Oct 14 03:08:44.425689 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 91/181] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:44 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:44.904567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:44.905178 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:44.910998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:44.911480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:44.911909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:44.912585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:44.913032 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:44.913450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:44.973666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:44.981675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-aaf6a717-d6cc-4c23-bd42-88eaeea2d292 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1223 microversion: 2.1 time: 0.080890 Oct 14 03:08:44.982282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 91/182] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:44 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:45.384039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:45.387170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:45.390980 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:45.391927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:45.392299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.392986 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:45.393435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:45.393885 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.448686 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:45.449966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:45.456832 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:45.457529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:45.457969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.458675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:45.459129 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:45.459571 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:45.577327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:45.586300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7de94f5a-66ba-4df2-b682-fd9a1b4c2c35 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.205777 Oct 14 03:08:45.598102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 92/183] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:45 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:45.624748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:45.633017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-33232760-3104-441a-9671-5e84e4de392f tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1554 microversion: 2.1 time: 0.188967 Oct 14 03:08:45.633586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 92/184] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:45 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:46.005113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:46.005729 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:46.012726 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:46.013253 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:46.013645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:46.014366 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:46.014816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:46.015232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:46.076757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:46.086528 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cc9e68de-8498-485e-a2af-5792d233cedb tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1223 microversion: 2.1 time: 0.085176 Oct 14 03:08:46.087108 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 93/185] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:46 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:46.609870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:46.610471 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:46.617643 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:46.618152 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:46.618578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:46.619351 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:46.619791 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:46.620204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:46.656918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:46.658400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:46.665263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:46.666039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:46.666623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:46.667572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:46.668485 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:46.669127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:46.719109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:46.795544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:46.804147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-07519b7d-f97d-497c-ab96-b87479c4db6a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.197801 Oct 14 03:08:46.804866 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 93/186] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:46 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:46.871144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:46.884917 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5aa250cc-ea50-4a96-afd6-6a281171fd82 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1554 microversion: 2.1 time: 0.231349 Oct 14 03:08:46.885851 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 94/187] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:46 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:47.110059 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:47.110896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:47.118597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.119405 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.119974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:47.121037 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.121698 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.122744 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:47.229498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:47.245787 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2e8dbdba-d214-42bd-9994-ce7ff21fbdc1 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1271 microversion: 2.1 time: 0.140030 Oct 14 03:08:47.247904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 94/188] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:47 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:47.597824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-568a2bcc-4b5b-487a-8c7c-b1f78a5b9185 req-5ab648b2-018e-446c-87e4-d7f0a5af27c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706d7731-fcb4-4570-be80-854614a86150", "name": "network-vif-deleted", "tag": "c9eaee60-8415-4f9b-89cb-7e16d1dd5b4f"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:47.618576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-568a2bcc-4b5b-487a-8c7c-b1f78a5b9185 req-5ab648b2-018e-446c-87e4-d7f0a5af27c3 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.618576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-568a2bcc-4b5b-487a-8c7c-b1f78a5b9185 req-5ab648b2-018e-446c-87e4-d7f0a5af27c3 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.618576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-568a2bcc-4b5b-487a-8c7c-b1f78a5b9185 req-5ab648b2-018e-446c-87e4-d7f0a5af27c3 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:47.632040 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-568a2bcc-4b5b-487a-8c7c-b1f78a5b9185 req-5ab648b2-018e-446c-87e4-d7f0a5af27c3 service nova] Creating event network-vif-deleted:c9eaee60-8415-4f9b-89cb-7e16d1dd5b4f for instance 706d7731-fcb4-4570-be80-854614a86150 on hv-cinder-80152 Oct 14 03:08:47.637570 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-568a2bcc-4b5b-487a-8c7c-b1f78a5b9185 req-5ab648b2-018e-446c-87e4-d7f0a5af27c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047595 Oct 14 03:08:47.638301 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 95/189] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:08:47.827483 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:47.828009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:47.834542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.835020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.835446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:47.836125 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.836569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.836980 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:47.911264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:47.923078 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:47.930292 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.930784 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.931215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:47.931917 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:47.932367 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:47.932778 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:48.018632 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:48.022810 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:48.031770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-62c65729-271e-4e74-ac7c-5eac7f6edecc tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1345 microversion: 2.1 time: 0.124664 Oct 14 03:08:48.031994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fae39aca-27b3-4067-bd5d-b7a2a90fadbe tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.208266 Oct 14 03:08:48.032940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 95/190] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:47 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:48.045988 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 96/191] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:47 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:08:48.272563 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:48.273572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:48.280922 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:48.281730 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:48.283755 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:48.285558 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:48.287226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:48.288476 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:48.407370 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:48.420396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bb67a2c6-7700-409a-b2f8-398027353d73 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1277 microversion: 2.1 time: 0.153219 Oct 14 03:08:48.422009 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 97/192] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:48 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:49.058275 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:49.059516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:49.062382 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:49.062997 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:49.068265 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:49.070703 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:49.071313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:49.072090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:49.072548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:49.073120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:49.073301 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:49.073739 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:49.080952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:49.080952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:49.080952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:49.080952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:49.117990 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:49.118507 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:49.119039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:49.119485 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lazy-loading 'fault' on Instance uuid 706d7731-fcb4-4570-be80-854614a86150 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:08:49.186947 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7517af640df3402783a38befbf3d3908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cd113c7d65543b2bac8ef368467c092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:49.196495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d171283b-2f13-420d-9547-8b6e48e9bba9 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 200 len: 1350 microversion: 2.1 time: 0.138583 Oct 14 03:08:49.197381 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 98/193] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:49 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:49.249570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:49.258067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d263ed04-dbe7-4783-94a3-80852a7780ac tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.204188 Oct 14 03:08:49.258647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 96/194] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:49 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:49.448182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:49.448938 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:49.455265 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:49.456778 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:49.456778 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:49.457078 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:49.457594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:49.458107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:49.789967 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:49.797622 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2a7e4e2f-215f-4c38-8352-906200360f64 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1319 microversion: 2.1 time: 0.354098 Oct 14 03:08:49.798214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 99/195] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:49 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:49.859211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-c8721cd5-2b10-42ee-b8c8-7fbb6ac4cd53 req-a88a2233-4891-4262-8dc8-130370de1feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa1b038-3bf4-4429-bd6e-691a1abe5081", "tag": "72241d51-c58b-48bf-bd3d-37d0d0d26fd4"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:49.872411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-c8721cd5-2b10-42ee-b8c8-7fbb6ac4cd53 req-a88a2233-4891-4262-8dc8-130370de1feb service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:49.873213 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-c8721cd5-2b10-42ee-b8c8-7fbb6ac4cd53 req-a88a2233-4891-4262-8dc8-130370de1feb service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:49.874027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-c8721cd5-2b10-42ee-b8c8-7fbb6ac4cd53 req-a88a2233-4891-4262-8dc8-130370de1feb service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:49.886199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-c8721cd5-2b10-42ee-b8c8-7fbb6ac4cd53 req-a88a2233-4891-4262-8dc8-130370de1feb service nova] Creating event network-changed:72241d51-c58b-48bf-bd3d-37d0d0d26fd4 for instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 on hv-cinder-80152 Oct 14 03:08:49.892014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-c8721cd5-2b10-42ee-b8c8-7fbb6ac4cd53 req-a88a2233-4891-4262-8dc8-130370de1feb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037151 Oct 14 03:08:49.892796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 97/196] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:50.219831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:50.220433 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:50.226977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.227708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.228133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.229003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.229618 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.230213 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.244641 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] HTTP exception thrown: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Request method failure captured: Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 HTTP/1.1 Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNKDn0PfoiUXygTwiU_yKrpuZhvLqmswazq1axEt889JpTzJqnAffh2ejxX3yh2rrRNWEIpwPGSlIsdDDfbMygXwuq5gtNsEGB--ocL3AOTGxnXeAkXX-X4F-cJJT-Ze8bEHsczKvgbHQXzVc2mJ-qy34jaAuohvZhMciMzt_O9y8iU Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 5cd113c7d65543b2bac8ef368467c092 Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:08:50.249226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5cd113c7d65543b2bac8ef368467c092"}]}] Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 5cd113c7d65543b2bac8ef368467c092 Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-DeleteServersTestJSON-2057772735-project Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 7517af640df3402783a38befbf3d3908 Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-DeleteServersTestJSON-2057772735-project Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.250744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '706d7731-fcb4-4570-be80-854614a86150'} Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:08:50.251786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.253518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.257936 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Returning 404 to user: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:08:50.257936 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c49b5f8a-ce2f-4a03-87f6-93d8fadff4b5 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 404 len: 111 microversion: 2.1 time: 0.034731 Oct 14 03:08:50.257936 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 100/197] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:50 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:08:50.282077 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:50.282804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:50.289399 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.289996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.290367 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.291071 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.291522 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.292145 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.472944 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:50.484912 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:50.485616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-03088380-f02b-4aa8-8cb0-ef27055b13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.208811 Oct 14 03:08:50.486565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 98/198] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:50 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:50.488312 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:50.494821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.495472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.496055 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.496877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.497454 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.498176 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.512821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] HTTP exception thrown: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Request method failure captured: Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150/os-volume_attachments HTTP/1.1 Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNKDn0PfoiUXygTwiU_yKrpuZhvLqmswazq1axEt889JpTzJqnAffh2ejxX3yh2rrRNWEIpwPGSlIsdDDfbMygXwuq5gtNsEGB--ocL3AOTGxnXeAkXX-X4F-cJJT-Ze8bEHsczKvgbHQXzVc2mJ-qy34jaAuohvZhMciMzt_O9y8iU Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 5cd113c7d65543b2bac8ef368467c092 Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:08:50.514429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5cd113c7d65543b2bac8ef368467c092"}]}] Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 5cd113c7d65543b2bac8ef368467c092 Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-DeleteServersTestJSON-2057772735-project Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 7517af640df3402783a38befbf3d3908 Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-DeleteServersTestJSON-2057772735-project Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.515872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'server_id': '706d7731-fcb4-4570-be80-854614a86150'} Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:08:50.516688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:50.525351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:50.526800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Returning 404 to user: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:08:50.526800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c8380722-7172-4cfa-90a7-c2ad14ff8a65 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037761 Oct 14 03:08:50.526800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 101/199] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:08:50 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:08:50.821469 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:50.822153 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:50.831054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.831054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.831054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.831054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:50.831446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:50.831446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:50.961582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:50.969331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cbefd97b-1419-44d1-91d5-4711ef4c4d07 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1319 microversion: 2.1 time: 0.152471 Oct 14 03:08:50.969927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 99/200] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:50 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:51.508625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:51.509228 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:51.515317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:51.515866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:51.516306 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:51.516989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:51.517446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:51.517895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:51.647950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:51.655573 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5a79858f-c2ea-418d-9e8b-7deb231902ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.151066 Oct 14 03:08:51.658828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 102/201] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:51 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:51.992245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:51.992772 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:51.999179 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:51.999659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.000090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.000773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.001232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.001653 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.076943 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:52.077855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:52.089037 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.091030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.091030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.091030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.094038 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.094464 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.109314 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] HTTP exception thrown: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Request method failure captured: Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: DELETE /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 HTTP/1.1 Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNKDn0PfoiUXygTwiU_yKrpuZhvLqmswazq1axEt889JpTzJqnAffh2ejxX3yh2rrRNWEIpwPGSlIsdDDfbMygXwuq5gtNsEGB--ocL3AOTGxnXeAkXX-X4F-cJJT-Ze8bEHsczKvgbHQXzVc2mJ-qy34jaAuohvZhMciMzt_O9y8iU Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 5cd113c7d65543b2bac8ef368467c092 Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:08:52.116049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5cd113c7d65543b2bac8ef368467c092"}]}] Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 5cd113c7d65543b2bac8ef368467c092 Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-DeleteServersTestJSON-2057772735-project Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 7517af640df3402783a38befbf3d3908 Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-DeleteServersTestJSON-2057772735-project Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.117645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '706d7731-fcb4-4570-be80-854614a86150'} Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:08:52.118523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.119852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.121209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Returning 404 to user: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:08:52.121209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9891ad45-706e-43b5-b015-bca9b903cfd3 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "DELETE /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 404 len: 111 microversion: 2.1 time: 0.041067 Oct 14 03:08:52.121209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 103/202] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:08:52 2022] DELETE /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:08:52.125457 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:52.126170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] [instance: 706d7731-fcb4-4570-be80-854614a86150] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:52.133521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.134229 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.134738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.135537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.136103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.136606 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.151806 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] HTTP exception thrown: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Request method failure captured: Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 HTTP/1.1 Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNKDn0PfoiUXygTwiU_yKrpuZhvLqmswazq1axEt889JpTzJqnAffh2ejxX3yh2rrRNWEIpwPGSlIsdDDfbMygXwuq5gtNsEGB--ocL3AOTGxnXeAkXX-X4F-cJJT-Ze8bEHsczKvgbHQXzVc2mJ-qy34jaAuohvZhMciMzt_O9y8iU Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 5cd113c7d65543b2bac8ef368467c092 Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:08:52.153299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5cd113c7d65543b2bac8ef368467c092"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5cd113c7d65543b2bac8ef368467c092"}]}] Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 5cd113c7d65543b2bac8ef368467c092 Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-DeleteServersTestJSON-2057772735 Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-DeleteServersTestJSON-2057772735-project Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 7517af640df3402783a38befbf3d3908 Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-DeleteServersTestJSON-2057772735-project Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.154703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '706d7731-fcb4-4570-be80-854614a86150'} Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:08:52.155740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. Oct 14 03:08:52.157082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:08:52.161519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] Returning 404 to user: Instance 706d7731-fcb4-4570-be80-854614a86150 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:08:52.161519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-382b55ee-fbea-43e1-9474-6bec47da6536 tempest-DeleteServersTestJSON-2057772735 tempest-DeleteServersTestJSON-2057772735-project] 10.222.0.39 "GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150" status: 404 len: 111 microversion: 2.1 time: 0.039835 Oct 14 03:08:52.161519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 104/203] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:52 2022] GET /compute/v2.1/servers/706d7731-fcb4-4570-be80-854614a86150 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:08:52.163862 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:52.175644 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d52ed93d-4aa0-44ee-b3a6-90c7766defa7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1319 microversion: 2.1 time: 0.187153 Oct 14 03:08:52.176392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 100/204] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:51 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:52.680037 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:52.680810 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:52.687413 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.687972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.688659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.689425 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:52.689988 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:52.690469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:52.894826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:52.902901 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2816b0e3-52b7-44c1-9478-15320e3a3c7b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.227622 Oct 14 03:08:52.903631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 105/205] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:52 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:53.204660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:53.205429 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:53.212298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:53.212781 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:53.213215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:53.213956 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:53.214413 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:53.217454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:53.417995 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:53.425692 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-12e2a355-8a57-4984-8e29-15781a37e63b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1319 microversion: 2.1 time: 0.225079 Oct 14 03:08:53.426298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 101/206] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:53 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:53.928620 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:53.929792 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:53.933550 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:53.934855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:53.943386 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:53.947350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:53.947350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:53.947350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:53.947350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:53.947734 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:54.204124 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:54.207710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e77f69ef-f614-4940-bff7-d80351d1c18f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.285311 Oct 14 03:08:54.208266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 106/207] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:53 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:54.450105 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:54.451613 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:54.463074 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:54.471184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:54.474389 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:54.482925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:54.484335 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:54.485236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:54.486030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:54.826136 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:54.831236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:54.842227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bbd3ac16-2831-4366-9da9-d549034da637 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1319 microversion: 2.1 time: 0.396964 Oct 14 03:08:54.849180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 102/208] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:54 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:55.232814 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:55.233491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:55.240233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:55.240717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:55.241143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:55.242369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:55.242861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:55.243279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:55.483360 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:55.493523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-318ac423-642f-4ffe-8c67-b2f222e89e13 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.264629 Oct 14 03:08:55.494407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 107/209] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:55 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:55.869911 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:55.869911 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:55.875348 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:55.876131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:55.877044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:55.877912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:55.878428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:55.878927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:56.159965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:56.165369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bbe748e1-0076-4ce1-8aa1-b3028a96b29b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1319 microversion: 2.1 time: 0.301837 Oct 14 03:08:56.166187 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 103/210] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:55 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:56.531059 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:56.533538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:56.544128 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:56.545096 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:56.545791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:56.546653 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:56.547174 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:56.547682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:56.751666 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:56.754580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c1c007b2-d411-4472-8da5-4dbaae8e50e4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.237383 Oct 14 03:08:56.756619 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 108/211] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:56 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:57.144236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-1da4c5b0-b27c-4e01-9448-10a6baae0e90 req-37adb002-d4bb-477c-96e6-c3f31e348158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa1b038-3bf4-4429-bd6e-691a1abe5081", "name": "network-vif-plugged", "status": "completed", "tag": "72241d51-c58b-48bf-bd3d-37d0d0d26fd4"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:08:57.150050 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=71 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:57.156067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1da4c5b0-b27c-4e01-9448-10a6baae0e90 req-37adb002-d4bb-477c-96e6-c3f31e348158 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:57.156782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1da4c5b0-b27c-4e01-9448-10a6baae0e90 req-37adb002-d4bb-477c-96e6-c3f31e348158 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:57.157952 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1da4c5b0-b27c-4e01-9448-10a6baae0e90 req-37adb002-d4bb-477c-96e6-c3f31e348158 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:57.171289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-1da4c5b0-b27c-4e01-9448-10a6baae0e90 req-37adb002-d4bb-477c-96e6-c3f31e348158 service nova] Creating event network-vif-plugged:72241d51-c58b-48bf-bd3d-37d0d0d26fd4 for instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 on hv-cinder-80152 Oct 14 03:08:57.176477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-1da4c5b0-b27c-4e01-9448-10a6baae0e90 req-37adb002-d4bb-477c-96e6-c3f31e348158 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036014 Oct 14 03:08:57.177158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 104/212] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:08:57.195686 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:57.196294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:57.202842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:57.203328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:57.203764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:57.204455 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:57.204904 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:57.205324 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:57.378238 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:57.395664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-46f7149f-d28d-48d7-a434-5f10dfa901cd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1319 microversion: 2.1 time: 0.203220 Oct 14 03:08:57.408469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 109/213] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:57 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:57.783955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:57.785320 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:57.796597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:57.798535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:57.799557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:57.800489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:57.801170 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:57.804466 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:57.950992 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:57.959293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a6bdedb4-952d-43c5-ac2a-578863f38380 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.181403 Oct 14 03:08:57.959852 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 105/214] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:57 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:58.419659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:58.420206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:58.422111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:58.426648 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:58.427126 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:58.427608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:58.428298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:58.428745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:58.429190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:58.579340 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:58.588073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7088a424-f2d4-487e-ae04-1cb96a4719d6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1319 microversion: 2.1 time: 0.172416 Oct 14 03:08:58.588634 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 110/215] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:58 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:58.984112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:58.985282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:58.992283 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:58.992768 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:58.993188 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:58.993925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:58.994377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:58.994788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:59.136182 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:59.144730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6ca0c71e-22e0-49ea-aa14-5e32526f13ff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.165761 Oct 14 03:08:59.145347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 106/216] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:58 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:08:59.611034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:08:59.611676 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:08:59.618079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:59.618552 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:59.618976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:59.619723 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:08:59.620177 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:08:59.620589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:08:59.781722 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:08:59.792300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-01aff3e0-ce86-4484-8934-517fd5362e95 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1508 microversion: 2.1 time: 0.184833 Oct 14 03:08:59.792892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 111/217] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:08:59 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:00.168142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:00.169566 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:00.176576 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:00.177288 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:00.177890 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:00.178579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:00.179212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:00.179821 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:00.313078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:00.326509 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f2859867-4df9-4b6c-971e-7b1a9554aac3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.162349 Oct 14 03:09:00.327095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 107/218] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:00 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:01.349840 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:01.350478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:01.356815 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:01.357204 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:01.357629 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:01.358407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:01.359118 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:01.359537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:01.516934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:01.516934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ff7241ee-aa8b-4bfe-9bb5-99fc4fdecb9c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.163440 Oct 14 03:09:01.516934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 112/219] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:01 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:02.531993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:02.533419 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:02.540350 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:02.540827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:02.541254 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:02.541970 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:02.542418 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:02.544884 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:02.677376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:02.685718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-89507ea8-b09c-4ab3-8425-842debe8a773 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.157513 Oct 14 03:09:02.686307 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 108/220] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:02 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:03.713913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:03.714433 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:03.720381 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:03.720891 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:03.721317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:03.722025 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:03.727392 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:03.727392 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:03.852768 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:03.862739 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-99cdf75c-6fe7-4cf0-979e-7a83311a4143 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.152808 Oct 14 03:09:03.863324 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 113/221] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:03 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:04.885419 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:04.886052 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:04.892782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:04.893269 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:04.893705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:04.894428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:04.894881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:04.895301 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:05.037743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:05.045873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a6701878-9c28-41fb-8daf-27149344d8d3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.164838 Oct 14 03:09:05.046433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 109/222] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:04 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:06.068660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:06.070403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:06.076644 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:06.083488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:06.083488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:06.083488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:06.083488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:06.083811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:06.084473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:06.221802 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:06.230832 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4f63fc59-a823-4c5d-8022-80ff6a3cc6b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.165858 Oct 14 03:09:06.231411 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 114/223] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:06 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:07.264033 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:07.264866 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:07.271376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:07.271884 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:07.272312 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:07.273700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:07.274163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:07.274767 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:07.413514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:07.421829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d23d32e9-0ee6-4329-ab55-b257927b6333 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.161738 Oct 14 03:09:07.422334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 110/224] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:07 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:08.445128 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:08.445791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:08.451824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:08.452335 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:08.452851 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:08.453523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:08.454001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:08.454482 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:08.578293 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:08.585910 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-aa99f178-4c38-43d9-a4ff-8738a663b9ec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.144793 Oct 14 03:09:08.586475 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 115/225] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:08 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:09.608388 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:09.609253 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:09.615679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:09.616148 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:09.616573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:09.617731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:09.618202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:09.618616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:09.746604 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:09.754091 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0900c07d-98bb-4f02-a774-0a7715e6b07e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.149535 Oct 14 03:09:09.754652 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 111/226] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:09 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:10.776750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:10.777351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:10.783242 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:10.783711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:10.784132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:10.784803 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:10.785244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:10.785655 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:10.910035 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:10.917570 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6b24f1d4-7316-4a2f-8087-310545f7b59c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.145209 Oct 14 03:09:10.918152 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 116/227] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:10 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:11.940613 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:11.941287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:11.947915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:11.948391 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:11.948818 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:11.949500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:11.949977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:11.950549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:12.090254 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:12.098070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5f03e0e2-fb21-4ea9-98ae-c7cadb06f156 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.161316 Oct 14 03:09:12.098671 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 112/228] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:11 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:13.121010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:13.123391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:13.131159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:13.131159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:13.131159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:13.132137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:13.133258 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:13.133893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:13.279947 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:13.289990 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f95bc2f2-7726-4f1c-8b20-353749327fec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.171498 Oct 14 03:09:13.289990 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 117/229] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:13 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:14.312668 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:14.313379 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:14.320096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:14.320646 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:14.321163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:14.321951 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:14.322468 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:14.322964 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:14.451660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:14.459512 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9ce7c4c6-3289-4c57-b6b1-e159d084639b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1520 microversion: 2.1 time: 0.151506 Oct 14 03:09:14.460082 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 113/230] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:14 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:15.482198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:15.482812 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:15.488902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:15.489383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:15.489832 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:15.490518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:15.491086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:15.491513 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:15.670102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:15.677870 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2951d0eb-d1a5-4443-a454-1191941ff636 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1500 microversion: 2.1 time: 0.199496 Oct 14 03:09:15.683198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 118/231] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:15 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1500 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:15.701599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:15.702236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:15.708864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:15.709344 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:15.709802 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:15.710524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:15.710980 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:15.711403 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:15.856089 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:15.864155 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d441996f-aa47-4015-9871-e095f8cbf881 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1516 microversion: 2.1 time: 0.167090 Oct 14 03:09:15.868210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 114/232] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:15 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:17.774913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:17.777788 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:17.783718 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:17.785710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:17.785710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:17.785710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:17.785710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:17.786145 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:17.809935 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lazy-loading 'flavor' on Instance uuid 96d96e4d-ef17-461e-a4f4-ee55452c0223 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:09:18.208289 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8c921c30-5de1-4304-8c6e-de7c48f9eea0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223/action" status: 200 len: 32 microversion: 2.1 time: 0.437214 Oct 14 03:09:18.211359 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 119/233] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:09:17 2022] POST /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223/action => generated 32 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:09:18.219310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:18.219924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:18.228103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:18.229175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:18.230031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:18.231702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:18.232169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:18.232597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:18.373286 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:18.382115 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-846ae5e0-0544-4506-8f53-2fdebcfeb27e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.166779 Oct 14 03:09:18.383568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 115/234] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:18 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:19.406349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:19.407113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:19.413858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:19.414347 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:19.414773 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:19.415535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:19.416605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:19.417733 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:19.548899 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:19.556784 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e8b441d9-452c-47cc-b1ea-0c397bd2091a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.154785 Oct 14 03:09:19.561623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 120/235] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:19 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:20.580859 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:20.581464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:20.587814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:20.588289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:20.588721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:20.589458 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:20.589932 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:20.590377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:20.722968 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:20.730579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-404c4631-ef92-4dac-a624-813a56714c5e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.153605 Oct 14 03:09:20.731169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 116/236] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:20 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:21.756318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:21.757043 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:21.763624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:21.764102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:21.764535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:21.765223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:21.765671 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:21.766133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:21.917964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:21.921499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0daa7f00-06a9-4246-960f-88577cfc8284 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.168934 Oct 14 03:09:21.922248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 121/237] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:21 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:22.944432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:22.945073 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:22.951663 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:22.952191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:22.952626 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:22.953310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:22.953779 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:22.954207 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:23.250041 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:23.256932 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5d727f55-8a9d-4580-86ea-6f6a82f61328 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.316471 Oct 14 03:09:23.257495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 117/238] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:22 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:24.280811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:24.281505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:24.287609 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:24.288064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:24.288509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:24.289170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:24.289613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:24.290059 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:24.429895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:24.440512 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-184a4d7c-b6e2-4a16-b6bd-647fbbb67095 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.164053 Oct 14 03:09:24.441078 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 122/239] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:24 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:25.463341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:25.464065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:25.471120 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:25.471599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:25.472031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:25.472714 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:25.473166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:25.473582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:25.613325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:25.622013 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6e213848-dc4e-46e4-bf5c-b71f6b574d17 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.162391 Oct 14 03:09:25.622602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 118/240] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:25 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:26.645645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:26.646277 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:26.653054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:26.653522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:26.653980 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:26.654662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:26.655105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:26.655516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:26.789935 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:26.798753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ef509cb1-afc8-4e0d-9e1a-ad08c2992481 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.156998 Oct 14 03:09:26.799515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 123/241] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:26 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:27.007556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:27.008070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:27.015037 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:27.015515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:27.015941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:27.016630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:27.017073 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:27.017492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:27.019974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=93 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:27.040768 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6aa6b6b0-93f2-49a3-aa11-fb95ccdecda0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/ips" status: 200 len: 146 microversion: 2.1 time: 0.037057 Oct 14 03:09:27.041318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 119/242] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:09:27 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:27.826328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:27.829408 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:27.835624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:27.836113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:27.836693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:27.837396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:27.837882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:27.838311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:27.969747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:27.978022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-08008bca-745e-45d9-a424-f13e8befe0db tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.155994 Oct 14 03:09:27.978710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 124/243] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:27 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:29.000814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:29.005936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:29.005936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=32 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:29.011189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:29.011189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:29.011189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:29.011189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:29.011592 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:29.011921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:29.143030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:29.150967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1e2f082c-82c7-4eea-89d9-9c5bec4b58cd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.154261 Oct 14 03:09:29.151519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 120/244] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:28 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:30.039557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:30.040079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:30.046878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.047463 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.047853 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.048839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.049391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.049877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.077387 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2120f01d-9d4e-473f-9b68-05ac0f241b7c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/ips" status: 200 len: 149 microversion: 2.1 time: 0.041687 Oct 14 03:09:30.081099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 125/245] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:09:30 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:30.175128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:30.175776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:30.182235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.182722 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.183157 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.184466 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:30.184920 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:30.185373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:30.326580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:30.353357 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8a95dc7d-306f-45f4-92e9-45c348e262b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.182106 Oct 14 03:09:30.353979 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 121/246] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:30 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:31.381365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:31.382163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:31.384105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=32 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:31.404420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:31.404420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:31.404420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:31.405590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:31.405856 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:31.406301 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:31.568285 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:31.576106 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1d1c2ce6-1f84-42e1-bfb4-c5339fdb4206 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.201411 Oct 14 03:09:31.576677 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 126/247] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:31 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:31.953935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e807d28-dde3-48d0-91ce-1ade4084204b"}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:31.956917 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:31.964065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:31.964566 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:31.965508 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:31.966245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:31.966861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:31.967304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.599534 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:32.600436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:32.606326 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.606810 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.607237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.607956 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.608402 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.609298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.742389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:32.751014 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7a4fa817-67c5-4c5d-b6c6-71fc36f6d844 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.155439 Oct 14 03:09:32.751579 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 127/248] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:32 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:32.848337 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0146f3e4-0985-4c21-9f04-270e92ae4d08 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898185 Oct 14 03:09:32.849032 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 122/249] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:09:31 2022] POST /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 194 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:32.853159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e31dff59-7996-4f71-9073-cda7bad6c598", "device": "/dev/sdb"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:32.857022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:32.864810 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.872287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.872882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:32.873649 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:32.874150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:32.874579 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.193061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:33.227691 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5e9647-d521-4713-9039-56e3084b9eb9"}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:33.231005 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:33.238202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.239184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.239357 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.240194 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.240648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.241074 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.869788 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8a2706e3-658b-4770-bf08-d43d3b1f104e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "POST /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.020489 Oct 14 03:09:33.870478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 128/250] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:09:32 2022] POST /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081/os-volume_attachments => generated 194 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:09:33.876575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:33.877368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:33.893682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.894214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.894637 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:33.895343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:33.895793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:33.896215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:34.036091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:34.045533 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d44674bc-542e-43a5-a766-0702ec9b4739 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.173809 Oct 14 03:09:34.046308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 129/251] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:33 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:34.195735 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-07fb7092-a4b0-4f54-8d24-9ca5a8d1d9c9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.973062 Oct 14 03:09:34.196386 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 123/252] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:09:33 2022] POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/os-volume_attachments => generated 194 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:35.067916 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:35.068528 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:35.074886 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.075890 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.076317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.076996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:35.077442 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:35.077883 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:35.228730 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:35.237130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9e0c5b80-d30c-4328-8a9a-ec7e90ead04a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.172996 Oct 14 03:09:35.237687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 130/253] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:35 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:36.263291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:36.264033 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:36.271978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:36.271978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:36.271978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:36.271978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:36.272313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:36.272666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:36.408753 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:36.416609 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f0a0ce86-097c-4285-bf1c-1852ae47d012 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.159315 Oct 14 03:09:36.417167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 124/254] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:36 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:37.446414 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:37.447059 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:37.454201 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.454684 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.455123 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.455819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:37.456277 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:37.456700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:37.586909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:37.595443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-36551f46-b8a4-47c0-ab5e-e800754b1bda tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.152797 Oct 14 03:09:37.596372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 131/255] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:37 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:38.619020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:38.619548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:38.626130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:38.626600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:38.627032 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:38.627704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:38.628151 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:38.628565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:38.759269 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:38.766888 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e0b3be1f-d53a-41f0-bfe1-506f8d9480a3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1502 microversion: 2.1 time: 0.151834 Oct 14 03:09:38.767445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 125/256] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:38 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:38.789655 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b2bf4c7-a63c-42c4-8588-d340efb4b755"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:38.792115 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:38.799186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:38.799668 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:38.800101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:38.801187 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:38.801280 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:38.801634 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:38.824796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] HTTP exception thrown: Cannot 'attach_volume' instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 while it is in vm_state rescued Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Request method failure captured: Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: POST /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223/os-volume_attachments HTTP/1.1 Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 74 Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ-3La-kNpIaXxqS92x0RHqvXA16s4kGRVTPJOh9I4w33TN-8Kdm8KMswN-0sAhEnPB8F84xOWZd6MrRCKjPYbDU5wVTU3x-ea7nO92kSrT1cxdlWI2bwsOq6wbJoNZUr3bHwytcu5-fP6WVB8itTPTt4-KZM83SljPw5elkacbB5U Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:09:38.826504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_44d8a8798bc64aefadd52c30a21002ef"}]}] Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {"volumeAttachment": {"volumeId": "4b2bf4c7-a63c-42c4-8588-d340efb4b755"}} Oct 14 03:09:38.831264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Cannot 'attach_volume' instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 while it is in vm_state rescued Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'server_id': '96d96e4d-ef17-461e-a4f4-ee55452c0223', 'body': {'volumeAttachment': {'volumeId': '4b2bf4c7-a63c-42c4-8588-d340efb4b755'}}} Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:09:38.832073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 while it is in vm_state rescued Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:09:38.833365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:09:38.834650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:09:38.834650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:09:38.834650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 while it is in vm_state rescued Oct 14 03:09:38.834650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:09:38.834650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Returning 409 to user: Cannot 'attach_volume' instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 while it is in vm_state rescued {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:09:38.834650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-57ebc9d9-9fca-4a73-a436-61daab967995 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042357 Oct 14 03:09:38.834650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 132/257] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:09:38 2022] POST /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 14 03:09:38.837178 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:38.837698 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:38.844251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:38.844582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:38.845006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:38.845704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:38.846168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:38.846583 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.057635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a92b3c2a-d050-4951-acf4-f70d0b00ad96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223/action" status: 202 len: 0 microversion: 2.1 time: 0.224201 Oct 14 03:09:39.058325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 126/258] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:09:38 2022] POST /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:09:39.066308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:39.066921 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:39.072941 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:39.073420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:39.073949 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.074682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:39.075114 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:39.075532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:39.206900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:39.215349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cbbac238-39be-44da-a93b-b490bd77f6be tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1510 microversion: 2.1 time: 0.152764 Oct 14 03:09:39.216118 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 133/259] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:39 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:40.240911 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:40.241595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:40.247744 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:40.248214 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:40.248652 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:40.249362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:40.249966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:40.250390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:40.381279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:40.390247 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e7aacaca-ed6c-4dfe-88b8-1501211a955a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1510 microversion: 2.1 time: 0.153446 Oct 14 03:09:40.392300 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 127/260] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:40 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:41.414093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:41.414694 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:41.421882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:41.423985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:41.423985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:41.423985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:41.424245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:41.424583 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:41.554839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:41.563595 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0d71b928-5777-4fd5-ad83-7e4eb68ddc5f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1510 microversion: 2.1 time: 0.153471 Oct 14 03:09:41.564503 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 134/261] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:41 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:41.629287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-df8afd8a-cb9d-4b1a-b178-1a0cad156363 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: .version_select at 0x7f2bebb37790>, body: {"keypair": {"name": "tempest-keypair-314747716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuedtK0oaH91ZCBVDr5nPyQXhC/0+FZiEfdTwPwLQLR6dySTDj5oA+rmkiuL4z4i2VY/gAvEqTqpEOKTbC75kEJ7WhSdOAA/FQci/jPOM5SjEPkyZP7cryTBZOqGJIYWA=="}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:41.645452 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-df8afd8a-cb9d-4b1a-b178-1a0cad156363 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for project 20fb24be77624e59b8560c7863ca4a46. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:41.649428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-df8afd8a-cb9d-4b1a-b178-1a0cad156363 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for user 410b7c9e93c94ce78d1b5c0e646307a2 and project 20fb24be77624e59b8560c7863ca4a46. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:41.729446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-df8afd8a-cb9d-4b1a-b178-1a0cad156363 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103940 Oct 14 03:09:41.730070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 128/262] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:09:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:42.208767 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:42.209261 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:42.215594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.216081 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.217046 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.217735 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.218215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.218631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.242720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-20703a0f-6dc9-45b2-915c-7ab1a06084b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/ips" status: 200 len: 153 microversion: 2.20 time: 0.038025 Oct 14 03:09:42.250022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 135/263] 10.222.0.39 () {60 vars in 1289 bytes} [Fri Oct 14 03:09:42 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/ips => generated 153 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:09:42.586705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:42.587417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:42.593592 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.594122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.594563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.595280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:42.596705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:42.597176 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:42.748088 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:42.755880 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-39b3e02f-1bd3-4989-b3a3-07f8f781471a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1510 microversion: 2.1 time: 0.173170 Oct 14 03:09:42.756442 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 129/264] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:42 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:43.826244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:43.826244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:43.826244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:43.826244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:43.827816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:43.827816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:43.827816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:43.827816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:43.918373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:43.926018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7a1ee9aa-1f5d-4a19-a9f5-9c8dc5144675 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1516 microversion: 2.1 time: 0.151453 Oct 14 03:09:43.926655 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 136/265] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:43 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:44.629996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1224485961", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb28930e-3d0a-43c7-985a-b1d6573d124d"}], "security_groups": [{"name": "tempest-securitygroup--1451690681"}], "key_name": "tempest-keypair-314747716", "user_data": "}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:44.735190 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] validate_networks() for [('bb28930e-3d0a-43c7-985a-b1d6573d124d', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:09:45.061864 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:45.062446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:45.070964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.071578 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.072165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.072836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.073283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.073703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.098639 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lazy-loading 'flavor' on Instance uuid d95dafdb-f3bf-4f25-96bc-6595e7f52a89 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:09:45.125189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:09:45.125609 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:09:45.126100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:09:45.126507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:09:45.126915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:09:45.135341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.135808 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.136231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.136946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.137389 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.138423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.155212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for project 20fb24be77624e59b8560c7863ca4a46. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:45.159166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for user 410b7c9e93c94ce78d1b5c0e646307a2 and project 20fb24be77624e59b8560c7863ca4a46. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:45.170210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:09:45.172423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:09:45.297261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-40083c61-6532-417d-b7ea-95c2c0322455 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.673992 Oct 14 03:09:45.297928 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 130/266] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:09:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:09:45.308718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f0578d7b-a874-4bd5-9456-d72f17e2c76a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:45.309514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f0578d7b-a874-4bd5-9456-d72f17e2c76a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:45.373688 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f0578d7b-a874-4bd5-9456-d72f17e2c76a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.381090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f0578d7b-a874-4bd5-9456-d72f17e2c76a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1241 microversion: 2.1 time: 0.075989 Oct 14 03:09:45.381651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 131/267] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:45 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:45.595502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3ee50119-dbc6-4294-97cb-c1d1e79b330e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/action" status: 202 len: 0 microversion: 2.20 time: 0.538638 Oct 14 03:09:45.596103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 137/268] 10.222.0.39 () {62 vars in 1319 bytes} [Fri Oct 14 03:09:45 2022] POST /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:09:45.613565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:45.617385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:45.628339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.628788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.629263 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.630485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:45.631014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:45.631394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:45.681532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d38bb820-7f58-4ffe-af35-f049f8174bba tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'create', calling method: .version_select at 0x7f2beba7f1f0>, body: {"keypair": {"name": "tempest-keypair-436493738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFikYiTwCdjDGncKQgyggmrRsa/wU/ZIFZ6gxEa/ClFfet4r1ffOVPM5YoOPv5Wt5bkrYq+/JJc+r1upwl7QPdJXOQCLISu43GWxu7qyJ7mgBVm/meQLtFM0tjL8MNxD5g=="}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:45.714785 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-d38bb820-7f58-4ffe-af35-f049f8174bba tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Getting quotas for project 44d8a8798bc64aefadd52c30a21002ef. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:45.720909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-d38bb820-7f58-4ffe-af35-f049f8174bba tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Getting quotas for user 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b and project 44d8a8798bc64aefadd52c30a21002ef. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:45.789241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.797618 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.799102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:45.800261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-01c4505f-093f-46bb-846d-08b5ced3e826 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.199356 Oct 14 03:09:45.801015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 132/269] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:45 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:45.863284 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d38bb820-7f58-4ffe-af35-f049f8174bba tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187076 Oct 14 03:09:45.864443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 138/270] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:09:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:09:46.404587 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:46.405218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:46.411286 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.412739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.412739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.413026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.413478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.413923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.476602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:46.485685 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6e871792-024d-469f-92bc-f7bba3b2166c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1245 microversion: 2.1 time: 0.084992 Oct 14 03:09:46.486802 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 133/271] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:46 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:46.827087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:46.830616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:46.838752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.839238 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.840382 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.841792 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:46.842197 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:46.842625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:46.984548 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:46.992967 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:46.994453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:46.995682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b01a07cd-bbdb-4832-9593-e6f98bb728d5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.173315 Oct 14 03:09:46.996456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 139/272] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:46 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:47.513494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:47.514992 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:47.522668 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:47.523495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:47.524083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:47.525277 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:47.526077 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:47.526672 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:47.590563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:47.598969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5a6a4ea8-f3e4-45b9-b3b5-8327ec7bca3d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1293 microversion: 2.1 time: 0.091543 Oct 14 03:09:47.599729 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 134/273] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:47 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:48.020825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:48.022200 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:48.029273 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:48.030198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:48.030685 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:48.031474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:48.032158 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:48.033175 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:48.328528 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:48.337200 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:48.344706 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:48.344706 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-530ea9c4-e802-437a-9024-af71c70b38ab tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.323258 Oct 14 03:09:48.344706 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 140/274] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:48 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:48.622771 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:48.623392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:48.629921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:48.630598 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:48.631035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:48.631727 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:48.632180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:48.632604 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:48.638355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:48.702923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:48.722006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f25167ef-ad54-4f50-8398-d27186a2f937 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1299 microversion: 2.1 time: 0.103677 Oct 14 03:09:48.725119 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 135/275] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:48 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:48.861942 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2129764166", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55f1e2d7-2b20-46bb-a21a-28526552f799"}], "security_groups": [{"name": "tempest-securitygroup--1583607770"}], "key_name": "tempest-keypair-436493738", "user_data": "}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:48.972356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] validate_networks() for [('55f1e2d7-2b20-46bb-a21a-28526552f799', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:09:49.365646 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:49.366534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:49.379450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.380417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.381055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.382880 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.383619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.384384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.398752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:09:49.399176 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:09:49.399917 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:09:49.400618 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:09:49.401206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:09:49.412493 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.413319 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.414087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.415079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.415535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.416268 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.435510 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Getting quotas for project 44d8a8798bc64aefadd52c30a21002ef. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:49.440127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Getting quotas for user 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b and project 44d8a8798bc64aefadd52c30a21002ef. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:49.452404 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:09:49.454993 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:09:49.536044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.544922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.546499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.547758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d0b882ed-df1d-4ae8-9510-3d8dfdb31936 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.186105 Oct 14 03:09:49.548393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 136/276] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:49 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:09:49.565419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-25c5d217-afaf-45fb-a58f-e3473db91b24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.708608 Oct 14 03:09:49.578320 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 141/277] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:09:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:09:49.590614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fd744679-0889-4846-af0d-cbb04848c79a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:49.592163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fd744679-0889-4846-af0d-cbb04848c79a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:49.690924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fd744679-0889-4846-af0d-cbb04848c79a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.698775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fd744679-0889-4846-af0d-cbb04848c79a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1245 microversion: 2.1 time: 0.113961 Oct 14 03:09:49.699555 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 137/278] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:49 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:49.747648 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:49.748519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:49.759808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.760310 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.760771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.763887 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:49.764365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:49.766766 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:49.912306 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:49.920177 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-484caed1-bb09-441e-a158-169f0bc6bb43 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.176939 Oct 14 03:09:49.920929 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 142/279] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:49 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:50.255886 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-b89b7929-b78b-4247-a680-def494a12be2 req-fe079033-85a3-4b53-801f-72b50b9e1b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174ff84e-3115-4222-a659-4725858ef844", "tag": "c0076cbe-9dc5-4a27-b4f0-6470011daec6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:50.268965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-b89b7929-b78b-4247-a680-def494a12be2 req-fe079033-85a3-4b53-801f-72b50b9e1b4a service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.269963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-b89b7929-b78b-4247-a680-def494a12be2 req-fe079033-85a3-4b53-801f-72b50b9e1b4a service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.270567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-b89b7929-b78b-4247-a680-def494a12be2 req-fe079033-85a3-4b53-801f-72b50b9e1b4a service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.281845 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-b89b7929-b78b-4247-a680-def494a12be2 req-fe079033-85a3-4b53-801f-72b50b9e1b4a service nova] Creating event network-changed:c0076cbe-9dc5-4a27-b4f0-6470011daec6 for instance 174ff84e-3115-4222-a659-4725858ef844 on hv-cinder-80152 Oct 14 03:09:50.287380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-b89b7929-b78b-4247-a680-def494a12be2 req-fe079033-85a3-4b53-801f-72b50b9e1b4a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038114 Oct 14 03:09:50.288132 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 138/280] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:09:50.573668 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:50.574335 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:50.580678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.581157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.581826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.582537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.582972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.583394 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.723802 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c0ba448d-4f77-48e3-b3f9-da6500936bed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:50.724492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c0ba448d-4f77-48e3-b3f9-da6500936bed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:50.732960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:50.742349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:50.743777 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:50.744945 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8d550207-5d5b-46d2-b92b-103e0636b732 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.175434 Oct 14 03:09:50.745551 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 143/281] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:50 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:50.786656 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c0ba448d-4f77-48e3-b3f9-da6500936bed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:50.793595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c0ba448d-4f77-48e3-b3f9-da6500936bed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1245 microversion: 2.1 time: 0.074645 Oct 14 03:09:50.794979 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 139/282] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:50 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:50.942921 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:50.943528 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:50.949519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.950616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.951304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:50.958246 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:50.958753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:50.959244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.112978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:51.116676 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:51.121506 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-88398058-4cf7-4665-a01b-fbe3cf5ee839 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.182229 Oct 14 03:09:51.133961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 144/283] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:50 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:51.770869 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:51.771479 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:51.780359 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:51.780844 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:51.781278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.782029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:51.782486 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:51.782909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.816925 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:51.817543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:51.824431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:51.824913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:51.825348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.826065 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:51.826520 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:51.826949 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:51.906599 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:51.916653 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f95f7069-ec49-4b29-bc0f-475d79ba0df4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1297 microversion: 2.1 time: 0.103812 Oct 14 03:09:51.917323 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 145/284] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:51 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:52.016189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:52.025968 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:52.027534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:52.029313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9a18b9c7-9f60-4ac4-8645-a3ef75e82c42 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.262424 Oct 14 03:09:52.029973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 140/285] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:51 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:52.146517 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:52.151738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:52.154193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.154678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.155282 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.156186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.156778 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.157343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.332446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:52.342392 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0d6da8d6-3808-4da6-92e7-2ea8568e1699 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.201437 Oct 14 03:09:52.343663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 146/286] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:52 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:52.940211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:52.940885 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:52.947376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.947864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.948301 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:52.949023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:52.949478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:52.949929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.010717 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.019253 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9e48a77f-4e6f-499a-b11c-0be9c59b108d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1297 microversion: 2.1 time: 0.082735 Oct 14 03:09:53.019791 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 141/287] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:52 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:53.054576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:53.055130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:53.062461 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.062943 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.063378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.064070 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.064589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.065018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.196885 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.204892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.206348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.207599 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-24ee554e-c52c-4b7a-87a9-e9830b277303 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.157012 Oct 14 03:09:53.208143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 147/288] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:53 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:53.367530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:53.368223 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:53.374878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.375351 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.375782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.376475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:53.376925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:53.377345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:53.501410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:53.509017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1512e3c3-87b8-4c7a-a0ac-e775e5e7e256 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.145400 Oct 14 03:09:53.509574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 142/289] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:53 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:54.042225 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:54.042376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:54.048283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.048762 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.049192 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.049914 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.050366 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.050790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.109934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:54.117479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2852c535-f476-4a8c-bb19-926969ba4f96 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1297 microversion: 2.1 time: 0.079556 Oct 14 03:09:54.118131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 148/290] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:54 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:54.232464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:54.233073 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:54.239809 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.240287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.240723 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.241458 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.241946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.242369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.383811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:54.383811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:54.385256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:54.386455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3fc98f3c-c341-4441-9a67-56a0fbdbf4c3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.157970 Oct 14 03:09:54.387009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 143/291] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:54 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:54.531058 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:54.531593 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:54.537457 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.537973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.538419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.539157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:54.539610 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:54.540028 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:54.667663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:54.674629 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4ce90ab9-c2b6-4816-9eb8-c821d810a8c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.147573 Oct 14 03:09:54.675181 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 149/292] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:54 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:55.139888 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:55.140501 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:55.145552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:55.147352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.147835 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.148268 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.148959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.149412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.149867 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.209893 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.217871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2005d3f0-d854-42e7-83a4-e04dfe6a4d91 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1297 microversion: 2.1 time: 0.081879 Oct 14 03:09:55.218448 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 144/293] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:55 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:55.412490 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:55.413098 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:55.419491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.419969 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.420402 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.421088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.421537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.421988 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.554650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.562911 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.564350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.565538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d76bad21-3889-486c-bdb9-70072c5241d6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.156935 Oct 14 03:09:55.566120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 150/294] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:55 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:55.699173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:55.701129 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:55.708788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.709267 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.709693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.710499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:55.711105 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:55.711671 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:55.847141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:55.855204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-64c6d8cb-9ca0-4418-816a-aa5459130d8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.159980 Oct 14 03:09:55.855786 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 145/295] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:55 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:56.240500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:56.241109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:56.246937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.248107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.248487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.249177 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.249626 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.250074 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.312326 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:56.319806 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7cad7970-8a25-4ca4-b964-668090987c5a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1297 microversion: 2.1 time: 0.083226 Oct 14 03:09:56.320386 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 151/296] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:56 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:56.590950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:56.592042 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:56.598031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.598564 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.598996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.599676 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.600211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.600629 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.737612 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:56.746732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:56.748184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:56.749365 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-eaaf1a0e-1efc-4ef8-aba7-24b2876c7b9d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.162300 Oct 14 03:09:56.749995 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 146/297] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:56 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:56.855881 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1782301925", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "networks": [{"uuid": "05232e0b-a0d1-419f-aeac-d0342ce1d8bc"}]}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:09:56.880819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:56.881584 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:56.888499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.889236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.889738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.890542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:56.891136 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:56.896468 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:56.917087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] validate_networks() for [('05232e0b-a0d1-419f-aeac-d0342ce1d8bc', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:09:57.118921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.127492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a05be21d-6a52-420b-baf7-111904163499 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.251671 Oct 14 03:09:57.128063 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 147/298] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:56 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:57.342648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:57.343613 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:57.344370 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:09:57.344865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:09:57.345421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:09:57.345962 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:09:57.346485 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:09:57.349529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.350217 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.353985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.353985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.353985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.353985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.355421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.357226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.357226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.357226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.357561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.358019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.375546 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Getting quotas for project 57c8543c66ed4a6889a7740932dc6433. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:09:57.379531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Getting quotas for user e9b2d8f2742d4e5a8576e16c122c95ac and project 57c8543c66ed4a6889a7740932dc6433. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:09:57.391541 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:09:57.393698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:09:57.422454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.426855 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-04bd2238-bb3e-43bf-b3fc-f5ea9af98f71 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1303 microversion: 2.1 time: 0.088032 Oct 14 03:09:57.427436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 148/299] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:57 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:57.521610 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bc3ee0d4-db6a-4865-b531-3c3e896d90c0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668805 Oct 14 03:09:57.534135 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8ec095a2-9de6-4d17-ab8f-66a9a0122b4f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:57.539848 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8ec095a2-9de6-4d17-ab8f-66a9a0122b4f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:57.540439 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 152/300] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:09:57.600457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8ec095a2-9de6-4d17-ab8f-66a9a0122b4f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.608531 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8ec095a2-9de6-4d17-ab8f-66a9a0122b4f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1214 microversion: 2.1 time: 0.078419 Oct 14 03:09:57.609581 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 149/301] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:57 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:57.774539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:57.775142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:57.781251 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.781730 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.782192 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.782881 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:57.783320 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:57.783911 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:57.914771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.923255 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.924679 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:57.925844 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a24a68c5-13f3-4ec4-aade-e6f95e5b1307 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.155426 Oct 14 03:09:57.926391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 153/302] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:57 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:58.150938 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:58.151475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:58.157960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.161195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.161195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.161195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.161195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.161542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.291784 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:58.300289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8ead5797-582c-49ec-b938-827f7273ec8c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.153271 Oct 14 03:09:58.300919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 150/303] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:58 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:58.451188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:58.451731 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:58.457593 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.458101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.458556 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.459236 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.459682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.460098 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.586170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:58.594654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b4832be9-41b1-4ccb-85f1-00fba924f300 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.147878 Oct 14 03:09:58.595217 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 154/304] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:58 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:58.632294 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:58.633133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:58.639574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.640054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.640482 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.641166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.641617 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.642067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.700946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:58.708511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-69139c70-6e50-4099-ab78-8a5359cca81b tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1218 microversion: 2.1 time: 0.080009 Oct 14 03:09:58.709011 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 151/305] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:58 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:58.951835 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:58.952435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:58.958827 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.959244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.959670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:58.960347 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:58.960791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:58.961208 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.090432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:59.098656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:59.100100 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:59.101263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8f02f2b1-7258-48e2-8148-6bef345a30f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.153939 Oct 14 03:09:59.101851 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 155/306] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:09:58 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:09:59.322787 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:59.323401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:59.325660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:59.330355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.330835 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.331267 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.331955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.332407 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.332833 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.457445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:59.464987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8ae6dc3e-120b-42f5-a700-7019615c7e42 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.146190 Oct 14 03:09:59.465550 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 152/307] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:59 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:09:59.618110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:59.618722 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:59.620606 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:59.625625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.626152 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.626582 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.627276 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.627879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.628307 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.737390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:09:59.738031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:09:59.744171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.744651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.745081 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.745895 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:09:59.746345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:09:59.746760 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:09:59.764137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:59.771653 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fe1351b5-9b0f-41e6-8da0-4b2332ea20f5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.157544 Oct 14 03:09:59.772216 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 156/308] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:59 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:09:59.811722 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:09:59.819401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-11d22122-a013-4651-935f-c5d1d4689cfb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1218 microversion: 2.1 time: 0.086149 Oct 14 03:09:59.819959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 153/309] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:09:59 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:00.127838 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:00.129042 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:00.137659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.138664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.139112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.139819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.140270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.140734 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.219781 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-5414a1ed-2b5f-44dd-81bb-0e7ed66f43dc req-1af8f4a7-135e-4e10-a5c8-2f4291db87b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174ff84e-3115-4222-a659-4725858ef844", "name": "network-vif-plugged", "status": "completed", "tag": "c0076cbe-9dc5-4a27-b4f0-6470011daec6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:00.230616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-5414a1ed-2b5f-44dd-81bb-0e7ed66f43dc req-1af8f4a7-135e-4e10-a5c8-2f4291db87b8 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.231106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-5414a1ed-2b5f-44dd-81bb-0e7ed66f43dc req-1af8f4a7-135e-4e10-a5c8-2f4291db87b8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.231510 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-5414a1ed-2b5f-44dd-81bb-0e7ed66f43dc req-1af8f4a7-135e-4e10-a5c8-2f4291db87b8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.245099 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-5414a1ed-2b5f-44dd-81bb-0e7ed66f43dc req-1af8f4a7-135e-4e10-a5c8-2f4291db87b8 service nova] Creating event network-vif-plugged:c0076cbe-9dc5-4a27-b4f0-6470011daec6 for instance 174ff84e-3115-4222-a659-4725858ef844 on hv-cinder-80152 Oct 14 03:10:00.250635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-5414a1ed-2b5f-44dd-81bb-0e7ed66f43dc req-1af8f4a7-135e-4e10-a5c8-2f4291db87b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037012 Oct 14 03:10:00.251526 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 154/310] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:00.312154 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:00.323834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:00.325462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:00.327477 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-961c4f4f-c610-484d-8765-5dae5f581fad tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.203646 Oct 14 03:10:00.328135 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 157/311] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:00 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:00.488826 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:00.489516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:00.495558 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.496030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.496483 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.497168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.498574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.498574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.633843 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:00.658203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-75709485-a23b-4204-815d-6c7ad4234794 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.174275 Oct 14 03:10:00.658800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 155/312] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:00 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:00.795596 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:00.796423 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:00.802869 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.803355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.803788 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.804481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.804928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.805451 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.842531 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:00.843140 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:00.849249 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.849745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.850221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.850909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.851357 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.851776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.855986 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:00.927124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:00.945401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-80379232-32b6-4f68-a206-6196f52b77df tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1266 microversion: 2.1 time: 0.106676 Oct 14 03:10:00.946397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 156/313] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:00 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:00.960078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-382d7b09-caca-496e-95be-d4427070d1aa req-583ae5e0-1938-4756-b3b8-5d7a4f5196d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07426fa3-a9d9-4304-854a-b6a298b3f8c7", "tag": "04f7e24a-0bec-4456-bb1a-56489e3f78c6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:00.971682 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-382d7b09-caca-496e-95be-d4427070d1aa req-583ae5e0-1938-4756-b3b8-5d7a4f5196d8 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:00.972393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-382d7b09-caca-496e-95be-d4427070d1aa req-583ae5e0-1938-4756-b3b8-5d7a4f5196d8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:00.972970 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-382d7b09-caca-496e-95be-d4427070d1aa req-583ae5e0-1938-4756-b3b8-5d7a4f5196d8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:00.984364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:00.985635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-382d7b09-caca-496e-95be-d4427070d1aa req-583ae5e0-1938-4756-b3b8-5d7a4f5196d8 service nova] Creating event network-changed:04f7e24a-0bec-4456-bb1a-56489e3f78c6 for instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 on hv-cinder-80152 Oct 14 03:10:00.994866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ca799522-6a1a-4325-be0b-a6b2f9c59586 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.204031 Oct 14 03:10:00.995552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-382d7b09-caca-496e-95be-d4427070d1aa req-583ae5e0-1938-4756-b3b8-5d7a4f5196d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035756 Oct 14 03:10:00.996260 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 157/314] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:00.996831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 158/315] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:00 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:01.355339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:01.356042 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:01.363071 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.363557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.363997 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.364689 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.365140 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.365565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.500110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.508489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.510184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.511326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cdb992f5-c198-4cc5-bed7-eb306e356390 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.160358 Oct 14 03:10:01.511871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 158/316] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:01 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:01.682132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:01.687390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:01.689125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.689608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.690083 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.690777 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.691232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.691654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.826567 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:01.834331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ddd71e1a-c59d-4ee4-bf96-36b9a5775ae6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.156421 Oct 14 03:10:01.834920 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 159/317] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:01 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:01.968395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:01.969006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:01.974979 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.975460 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.975894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:01.976577 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:01.977029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:01.977448 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.019942 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:02.020561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:02.026511 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.026935 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.027369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.028056 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.028550 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.028972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.037714 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.045525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-dd16f19d-98a9-4a85-8ee8-df01e2521ba0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1266 microversion: 2.1 time: 0.080980 Oct 14 03:10:02.046112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 159/318] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:01 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:02.157573 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.165312 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d0ccba19-e03d-4a9c-9a10-e20639d4e1e1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.149225 Oct 14 03:10:02.165896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 160/319] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:02 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:02.538012 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:02.538731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:02.546255 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.546986 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.547417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.548095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.548543 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.548958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.674252 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.682177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.683609 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:02.684795 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3741112b-4de9-45fa-8a00-0dfb6a6eff36 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.150918 Oct 14 03:10:02.685343 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 160/320] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:02 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:02.856220 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:02.856833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:02.863385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.863861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.864293 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.864977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:02.865426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:02.865872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:02.993434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.000995 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-196896dc-9c76-4880-bad6-bd48912200ac tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.148516 Oct 14 03:10:03.001578 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 161/321] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:02 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:03.068352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:03.068954 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:03.074848 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.075801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.076236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.076914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.077358 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.077790 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.136700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.144686 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-306f76ae-30f8-4d2c-99de-68e2e7655344 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1266 microversion: 2.1 time: 0.080121 Oct 14 03:10:03.145242 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 161/322] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:03 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:03.187105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:03.187717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:03.193589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.194044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.194475 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.195152 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.195599 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.196015 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.200020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:03.320682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.328792 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-42872b3f-4c60-4a0d-8aad-e4e137e462d0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.145538 Oct 14 03:10:03.329340 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 162/323] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:03 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:03.709994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:03.710597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:03.717100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.717572 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.718022 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.718700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:03.719142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:03.719560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:03.847030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.855161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.857135 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:03.858326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2e65f45c-e067-4fa4-aaa3-061eaafacc07 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.152267 Oct 14 03:10:03.859159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 162/324] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:03 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:04.023855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:04.024471 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:04.031487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.031969 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.032431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:04.033115 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.033568 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.034024 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:04.159855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:04.167453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ee85d5ab-0cad-418d-8a5b-a47b4d9605d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.147408 Oct 14 03:10:04.167609 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:04.168016 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 163/325] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:04 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:04.168233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:04.174791 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.175266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.175693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:04.176397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.176845 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.177259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:04.236197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:04.243706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cd4ac20d-0d57-449d-976b-fb32b92515a6 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1266 microversion: 2.1 time: 0.079906 Oct 14 03:10:04.244262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 163/326] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:04 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:04.351070 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:04.351671 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:04.357603 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.358116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.358544 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:04.359470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.359943 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.360357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:04.487773 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:04.495304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4a50b976-a21d-4647-b968-861aaca50270 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.148016 Oct 14 03:10:04.495858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 164/327] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:04 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:04.884461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:04.885123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:04.892320 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.892798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.893289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:04.894009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:04.894464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:04.894883 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.024760 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.032716 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.034158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.035296 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7d8e8e87-f34a-4586-8e0c-9f75785d7d33 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.154851 Oct 14 03:10:05.035838 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 164/328] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:04 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:05.190077 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:05.191333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:05.198213 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:05.198816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:05.199254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.199953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:05.200407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:05.200834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.266381 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:05.269572 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:05.276075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:05.276676 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:05.277175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.277973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:05.278530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:05.279029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.350516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.363759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.366540 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4232fc08-0a21-474f-82cc-250274f69166 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1266 microversion: 2.1 time: 0.104079 Oct 14 03:10:05.367146 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 165/329] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:05 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:05.376097 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-845bba61-3ba0-476e-b496-06cd330b410f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.189915 Oct 14 03:10:05.376662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 165/330] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:05 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:05.517342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:05.517999 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:05.524065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:05.524575 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:05.525007 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.525777 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:05.526271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:05.526739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:05.655067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:05.662838 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7505c8e1-4930-448f-a76f-e54fb4a0c0ed tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.149356 Oct 14 03:10:05.663392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 166/331] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:05 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:06.060272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:06.060978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:06.067497 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.068131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.068772 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.070373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.071108 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.071747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.094431 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7496a917-09ea-4f69-af24-e9fef8644ae8 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:06.101575 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7496a917-09ea-4f69-af24-e9fef8644ae8 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.102089 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7496a917-09ea-4f69-af24-e9fef8644ae8 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.102523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7496a917-09ea-4f69-af24-e9fef8644ae8 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.168495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7496a917-09ea-4f69-af24-e9fef8644ae8 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Going to try to stop instance {{(pid=119284) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 14 03:10:06.218875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.227838 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.229308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.230676 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-975b100c-43e5-4869-9b6c-ccb0e79c38d2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1746 microversion: 2.20 time: 0.174428 Oct 14 03:10:06.231242 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 166/332] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:06 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:06.349649 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7496a917-09ea-4f69-af24-e9fef8644ae8 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/action" status: 202 len: 0 microversion: 2.1 time: 0.259930 Oct 14 03:10:06.350291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 167/333] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:10:06 2022] POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:10:06.358512 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:06.359376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:06.365559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.366086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.366552 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.367245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.367697 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.368120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.390289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:06.390993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:06.396937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.397426 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.397868 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.398553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.399026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.399471 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.465042 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.472775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-240e1424-6495-4e59-a19d-c42b8a29498e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1266 microversion: 2.1 time: 0.087324 Oct 14 03:10:06.473331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 168/334] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:06 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:06.477837 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:06.478558 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:06.484613 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.485092 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.485521 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.486224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.486675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.487087 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.536608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.544789 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8bead2e6-d945-4330-8c65-2c3f21fb963f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.190261 Oct 14 03:10:06.545344 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 167/335] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:06 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:06.620173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.628351 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-dd109042-7207-458b-99d2-dae604990e17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1367 microversion: 2.1 time: 0.154058 Oct 14 03:10:06.628904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 169/336] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:06 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:06.686927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:06.687437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:06.694659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.695428 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.695973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.696900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:06.697210 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:06.697627 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:06.833514 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:06.841183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2bc653bc-77a9-4427-b17e-c38e419bde4c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.159227 Oct 14 03:10:06.841738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 168/337] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:06 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:07.257373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:07.258012 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:07.264268 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.264742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.265172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.265905 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.266354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.266773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.410177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.418559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.419986 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.421157 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1fa574af-7f45-47c9-8a97-d5371fc239ed tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1746 microversion: 2.20 time: 0.167691 Oct 14 03:10:07.421707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 170/338] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:07 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:07.496013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:07.496749 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:07.499313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=4 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:07.499978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=16 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:07.504855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.505340 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.505789 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.506501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.506952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.507371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.568750 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:07.574537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.578360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:07.584638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.585122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.585544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.586271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.586724 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-383a3045-1536-42f6-8132-9bd5289f85db tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1274 microversion: 2.1 time: 0.094371 Oct 14 03:10:07.586841 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.587177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.588177 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 169/339] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:07 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:07.607090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=18 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:07.651538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:07.652193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:07.659661 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.660490 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.661101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.663113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.663749 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.664334 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.788210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.797289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e4577757-50dc-458f-a008-4e4d56dafe5a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.232273 Oct 14 03:10:07.797893 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 171/340] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:07 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:07.841452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:07.850550 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5ec4c8cf-9b21-4500-b17e-6aff426370cb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1557 microversion: 2.1 time: 0.203378 Oct 14 03:10:07.851124 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 170/341] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:07 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1557 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:07.864014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:07.864700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:07.870841 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.871334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.871773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.873232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.873232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.873987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.882712 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:07.886272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:07.890474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:07.896067 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.896853 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.897453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:07.898343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:07.898855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:07.900270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.018322 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-353d5f7b-dfdd-43bb-ab8c-9dcc5993fe29 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144391 Oct 14 03:10:08.019276 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 171/342] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Oct 14 03:10:07 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:08.052956 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:08.060797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f3aa15a5-0956-480d-8155-80f64887ee47 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.200563 Oct 14 03:10:08.071514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 172/343] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:07 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:08.446705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:08.447504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:08.453690 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.454260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.455491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.455491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.455801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.456233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.589509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:08.598843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:08.600314 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:08.601513 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cd6e69ef-e4f9-4538-ba93-2189abc76b3b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1746 microversion: 2.20 time: 0.158917 Oct 14 03:10:08.602118 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 172/344] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:08 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:08.612095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:08.618747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:08.620607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.621344 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.622090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.622793 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.623240 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.623716 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.760264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:08.768462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f25d410b-c769-41ef-996d-27f468d8f936 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.161310 Oct 14 03:10:08.769044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 173/345] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:08 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:08.823702 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:08.824307 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:08.830758 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.831241 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.832093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.832389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:08.832831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:08.833283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:08.964149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:08.972743 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9aa035c4-eee1-40bb-beef-ced7de145be6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.153095 Oct 14 03:10:08.973314 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 173/346] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:08 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:09.023299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:09.023878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:09.030442 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.030989 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.031481 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.032234 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.032766 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.033245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.083801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:09.084878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:09.091038 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.091944 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.092856 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.093628 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.094313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.094772 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.166102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lazy-loading 'services' on Instance uuid ffa1b038-3bf4-4429-bd6e-691a1abe5081 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:09.229900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:09.238267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2fb8ad7e-ee10-4d30-8cbb-bb3813b2c8f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.158443 Oct 14 03:10:09.238996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 174/347] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:09 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:09.375296 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cbea1104-88f0-408c-b746-8858d396a25b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081/os-volume_attachments/e31dff59-7996-4f71-9073-cda7bad6c598" status: 202 len: 0 microversion: 2.1 time: 0.355760 Oct 14 03:10:09.376425 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 174/348] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:10:09 2022] DELETE /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081/os-volume_attachments/e31dff59-7996-4f71-9073-cda7bad6c598 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:10:09.410054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-7a488424-d456-4de9-b100-744dbf844df3 req-d8fffb02-0b12-4e26-98e4-6f7958fbc800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "174ff84e-3115-4222-a659-4725858ef844", "tag": "c0076cbe-9dc5-4a27-b4f0-6470011daec6"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:09.423772 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-7a488424-d456-4de9-b100-744dbf844df3 req-d8fffb02-0b12-4e26-98e4-6f7958fbc800 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.424254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-7a488424-d456-4de9-b100-744dbf844df3 req-d8fffb02-0b12-4e26-98e4-6f7958fbc800 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.424703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-7a488424-d456-4de9-b100-744dbf844df3 req-d8fffb02-0b12-4e26-98e4-6f7958fbc800 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.448914 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-7a488424-d456-4de9-b100-744dbf844df3 req-d8fffb02-0b12-4e26-98e4-6f7958fbc800 service nova] Creating event network-changed:c0076cbe-9dc5-4a27-b4f0-6470011daec6 for instance 174ff84e-3115-4222-a659-4725858ef844 on hv-cinder-80152 Oct 14 03:10:09.448914 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-7a488424-d456-4de9-b100-744dbf844df3 req-d8fffb02-0b12-4e26-98e4-6f7958fbc800 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047081 Oct 14 03:10:09.449371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 175/349] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:09.628684 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:09.630439 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:09.637293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.637796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.638231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.639002 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.639455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.639873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.782686 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:09.793043 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:09.793792 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:09.802514 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.803008 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.803444 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.804160 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:09.804620 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:09.805044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:09.815366 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:09.816904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:09.818168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6534c618-0f72-4783-b6c8-29c7ee097349 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1746 microversion: 2.20 time: 0.194556 Oct 14 03:10:09.818799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 175/350] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:09 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1746 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:09.961203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:09.973185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e72be263-f849-4a20-9b65-e41e12952068 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.184449 Oct 14 03:10:09.973751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 176/351] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:09 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:09.996087 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:09.996965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:10.003692 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.004601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.005249 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.006351 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.006806 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.007330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.153255 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:10.162626 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3aad3d37-c488-4cf7-bb27-3b82d2dad0ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.170251 Oct 14 03:10:10.165821 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 176/352] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:09 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:10.261088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:10.261707 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:10.267731 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.268220 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.268658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.269408 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.269892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.270326 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.621142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-7a6065ae-2810-49d5-9b06-a2ccd22a1089 req-7e652448-7f0f-4253-b1aa-785e0ee907a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dafdb-f3bf-4f25-96bc-6595e7f52a89", "name": "network-vif-plugged", "status": "completed", "tag": "e18b99a9-f003-40de-a7b1-30cc36ffa681"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:10.638742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-7a6065ae-2810-49d5-9b06-a2ccd22a1089 req-7e652448-7f0f-4253-b1aa-785e0ee907a0 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.639920 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-7a6065ae-2810-49d5-9b06-a2ccd22a1089 req-7e652448-7f0f-4253-b1aa-785e0ee907a0 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.640229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-7a6065ae-2810-49d5-9b06-a2ccd22a1089 req-7e652448-7f0f-4253-b1aa-785e0ee907a0 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.660151 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-7a6065ae-2810-49d5-9b06-a2ccd22a1089 req-7e652448-7f0f-4253-b1aa-785e0ee907a0 service nova] Creating event network-vif-plugged:e18b99a9-f003-40de-a7b1-30cc36ffa681 for instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 on hv-cinder-80152 Oct 14 03:10:10.689590 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-7a6065ae-2810-49d5-9b06-a2ccd22a1089 req-7e652448-7f0f-4253-b1aa-785e0ee907a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073719 Oct 14 03:10:10.695464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 177/353] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:10:10.796164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:10.805468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ede4db18-abd3-4088-8f4c-8bf905b8847b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.548073 Oct 14 03:10:10.806321 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 177/354] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:10 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:10.843971 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:10.844660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:10.850930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.851411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.852029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.852887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:10.853498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:10.853938 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:10.999390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:11.000305 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:11.010813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.011652 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.012311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.013354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.014779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.015678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.047996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.062599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.065911 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.069966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-662b6604-b5ad-444a-a536-6e43523b9ba6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.230121 Oct 14 03:10:11.070730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 178/355] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:10 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:11.183968 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.191171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:11.191781 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:11.201504 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.202026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.202462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.203304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.203754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.204172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.205625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c7534185-ee85-4e3b-9401-cb105e9c8fed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.207654 Oct 14 03:10:11.219227 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 178/356] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:10 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:11.379793 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:11.389972 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-af35cfda-1322-4376-a878-072ccb1985ef tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.201848 Oct 14 03:10:11.390391 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 179/357] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:11 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:11.464512 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-fa48c051-1fd7-4e91-87ea-d32f76e32ed3 req-0a9b38f4-7380-44da-8b45-6da811d2266e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7c6efa-eaaf-42f7-9c36-ddf200f81d73", "tag": "20488b98-4c60-43ee-8d98-91662e03db7f"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:11.474815 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-fa48c051-1fd7-4e91-87ea-d32f76e32ed3 req-0a9b38f4-7380-44da-8b45-6da811d2266e service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.475288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-fa48c051-1fd7-4e91-87ea-d32f76e32ed3 req-0a9b38f4-7380-44da-8b45-6da811d2266e service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.475709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-fa48c051-1fd7-4e91-87ea-d32f76e32ed3 req-0a9b38f4-7380-44da-8b45-6da811d2266e service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.487335 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-fa48c051-1fd7-4e91-87ea-d32f76e32ed3 req-0a9b38f4-7380-44da-8b45-6da811d2266e service nova] Creating event network-changed:20488b98-4c60-43ee-8d98-91662e03db7f for instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 on hv-cinder-80152 Oct 14 03:10:11.492544 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-fa48c051-1fd7-4e91-87ea-d32f76e32ed3 req-0a9b38f4-7380-44da-8b45-6da811d2266e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031582 Oct 14 03:10:11.493207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 179/358] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:11.633237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:11.633737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:11.640531 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.641153 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.641438 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.642167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.642616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.643152 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.672619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:10:11.833086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:11.834614 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:11.841527 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.842893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.843651 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.844590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.845153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.845692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.869640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:11.948161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4d08c781-d00b-401c-bf25-f9abfaa142fd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 204 len: 0 microversion: 2.1 time: 0.318397 Oct 14 03:10:11.950567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 180/359] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:10:11 2022] DELETE /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:10:11.960669 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:11.961619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:11.971690 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.975726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.976626 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.977546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:11.981493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:11.982134 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:11.994929 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.015049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b7951fa3-c3a8-4e01-a792-8c2227fa4321 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.186650 Oct 14 03:10:12.015890 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 180/360] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:11 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:12.102436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:12.103339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:12.110433 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.111212 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.111862 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.112892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.113617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.114134 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.178259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.187248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9cbeb8ea-d06d-40a6-9ac3-1c0319025102 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1514 microversion: 2.1 time: 0.231070 Oct 14 03:10:12.191481 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 181/361] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:11 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:12.235967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:12.236958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:12.244474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.245087 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.245779 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.246551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.247208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.247748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.266904 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.279290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.283991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.285253 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-77f4f813-9030-49af-9153-3810e35b51de tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.192659 Oct 14 03:10:12.302256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 181/362] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:12 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:12.415513 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:12.416226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:12.423757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.424911 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.425842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.426799 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.427478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.427997 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.428358 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.441437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ed92eaa8-d968-4eb9-aa30-ce2af33ef6c2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.209798 Oct 14 03:10:12.454710 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 182/363] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:12 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:12.593314 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:12.687630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cac102e9-0aed-4f88-bfae-b989c863926d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.219367 Oct 14 03:10:12.687630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 182/364] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:12 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:12.731783 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-db3dda0a-0f78-4dbd-b354-0cb3ed2503e5 req-9595af6b-cd73-425d-8df6-aac638edcf01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07426fa3-a9d9-4304-854a-b6a298b3f8c7", "name": "network-vif-plugged", "status": "completed", "tag": "04f7e24a-0bec-4456-bb1a-56489e3f78c6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:12.763392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-db3dda0a-0f78-4dbd-b354-0cb3ed2503e5 req-9595af6b-cd73-425d-8df6-aac638edcf01 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:12.775453 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-db3dda0a-0f78-4dbd-b354-0cb3ed2503e5 req-9595af6b-cd73-425d-8df6-aac638edcf01 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:12.776640 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-db3dda0a-0f78-4dbd-b354-0cb3ed2503e5 req-9595af6b-cd73-425d-8df6-aac638edcf01 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:12.790872 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-db3dda0a-0f78-4dbd-b354-0cb3ed2503e5 req-9595af6b-cd73-425d-8df6-aac638edcf01 service nova] Creating event network-vif-plugged:04f7e24a-0bec-4456-bb1a-56489e3f78c6 for instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 on hv-cinder-80152 Oct 14 03:10:12.798371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-db3dda0a-0f78-4dbd-b354-0cb3ed2503e5 req-9595af6b-cd73-425d-8df6-aac638edcf01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075219 Oct 14 03:10:12.799310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 183/365] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:13.039022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:13.044852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:13.049353 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.050065 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.050976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.051976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.052560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.053257 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.214696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:13.215564 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:13.228794 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:13.243752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ad3e2081-9beb-4f29-b582-86c3218f0bf1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.209377 Oct 14 03:10:13.248889 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 183/366] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:13 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:13.249601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.251746 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.252592 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.253317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.253998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.254216 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.316527 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:13.317478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:13.326974 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.327657 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.328212 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.329046 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.330784 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.330784 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.454297 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:13.463851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b5e8565c-f294-4f69-9d1d-f92618fcbc1c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1514 microversion: 2.1 time: 0.253844 Oct 14 03:10:13.472245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 184/367] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:13 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:13.477283 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:13.478126 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:13.496201 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.496630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.497177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.498071 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.498654 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.499310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.603097 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:13.611946 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:13.613493 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:13.614803 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7f3b84e6-8d2c-4e52-a5de-8549f9cd44dc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.305838 Oct 14 03:10:13.615597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 184/368] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:13 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:13.653746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:13.654454 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:13.664376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.664867 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.665497 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.666243 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:13.666701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:13.667126 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:13.684274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:13.701325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f657a7ab-8804-4a98-b36e-b65335961fa1 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.233143 Oct 14 03:10:13.702239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 185/369] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:13 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:13.805077 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:13.814117 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9844bb48-848c-4040-a5e9-4d4584a58f69 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.164082 Oct 14 03:10:13.814877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 185/370] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:13 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:14.272589 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:14.274095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:14.282014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.283120 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.283120 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.283724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.284182 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.284637 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.428354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.436636 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-20b18e4c-13c6-4628-bc27-ec5c57401913 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.168176 Oct 14 03:10:14.437196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 186/371] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:14 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:14.489156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:14.489840 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:14.496438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.496918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.497346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.498110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.498554 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.498969 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.631138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.638897 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a75bd7a9-416a-4b6e-912a-8ed6e783dfdd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1514 microversion: 2.1 time: 0.153537 Oct 14 03:10:14.642845 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:14.643586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:14.646397 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 186/372] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:14 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:14.649700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.651122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.651564 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.652264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.652718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.653167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.724186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:14.724800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:14.735481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.736163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.736782 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.737516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.738001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.738783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.908511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.918337 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.924970 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.926195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7516d650-2a90-4b67-8109-223d3069ead9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.287215 Oct 14 03:10:14.930058 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 187/373] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:14 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:14.934828 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:14.935382 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:14.941567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.942373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.942974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.943817 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:14.944412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:14.944974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:14.950474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:14.958927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-859f574a-123b-4f35-82bd-d246a1196d0c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.238546 Oct 14 03:10:14.959488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 187/374] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:14 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:14.960599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:15.129535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:15.144610 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c181ce64-a259-4562-9e14-b1cd109432b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.212778 Oct 14 03:10:15.144842 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 188/375] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:14 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:15.464635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:15.464635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:15.470937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.471440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.471876 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.472582 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.473036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.473561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.645744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:15.654174 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bbf2ec3b-9198-4acb-bb05-1d2b6e9166fa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.198272 Oct 14 03:10:15.655657 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 188/376] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:15 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:15.670550 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:15.671158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:15.680360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.680951 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.681450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.682358 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.683021 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.683506 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.829967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:15.838289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-60655ca5-ccc0-44d1-81f2-a6f68048699e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1514 microversion: 2.1 time: 0.173036 Oct 14 03:10:15.850434 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 189/377] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:15 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:15.960730 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:15.961341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:15.968894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.969375 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.969842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.970542 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:15.971185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:15.971779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:15.985365 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:15.986172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:16.000792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.001279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.017433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.018445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.018814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.019224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.246380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.261447 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.267093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.272000 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-38793aa9-164f-417e-95d2-c34ba1419a11 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.311808 Oct 14 03:10:16.272560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.297975 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 189/378] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:15 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:16.307077 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5855dd7b-f26d-4fc9-84fb-81b30fe16f0d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.326181 Oct 14 03:10:16.307599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 190/379] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:15 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:16.316621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:16.317358 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:16.323427 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.323918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.324532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.325472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.326670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.327110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.486116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.494613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-048aba9a-fd77-4b9d-b009-c0c3c8a63c9f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.195248 Oct 14 03:10:16.510403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 190/380] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:16 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:16.681232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:16.682471 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:16.695116 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.695926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.696552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.699211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.699937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.700573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.793881 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-e20fa76d-a7e6-48c4-a24d-50c1824e123c req-1eed5aba-7c13-4d3f-bcfe-75b3b57a8e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa1b038-3bf4-4429-bd6e-691a1abe5081", "name": "network-vif-deleted", "tag": "72241d51-c58b-48bf-bd3d-37d0d0d26fd4"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:16.806738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-e20fa76d-a7e6-48c4-a24d-50c1824e123c req-1eed5aba-7c13-4d3f-bcfe-75b3b57a8e56 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.807213 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-e20fa76d-a7e6-48c4-a24d-50c1824e123c req-1eed5aba-7c13-4d3f-bcfe-75b3b57a8e56 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.808405 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-e20fa76d-a7e6-48c4-a24d-50c1824e123c req-1eed5aba-7c13-4d3f-bcfe-75b3b57a8e56 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.838761 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-e20fa76d-a7e6-48c4-a24d-50c1824e123c req-1eed5aba-7c13-4d3f-bcfe-75b3b57a8e56 service nova] Creating event network-vif-deleted:72241d51-c58b-48bf-bd3d-37d0d0d26fd4 for instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 on hv-cinder-80152 Oct 14 03:10:16.848147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-e20fa76d-a7e6-48c4-a24d-50c1824e123c req-1eed5aba-7c13-4d3f-bcfe-75b3b57a8e56 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057739 Oct 14 03:10:16.855472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 191/381] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:10:16.861450 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:16.862543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:16.870099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.871330 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.871330 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.872376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.873768 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.874405 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.911518 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.921573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-54d074eb-1c00-476e-9629-74784cb9427e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1371 microversion: 2.1 time: 0.245385 Oct 14 03:10:16.937352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 191/382] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:16 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:16.937352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-601cacfb-5edb-4db6-acd7-4c8f79e98eaa req-06fc67cf-ecaf-402a-b73a-5a3b7e331824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7c6efa-eaaf-42f7-9c36-ddf200f81d73", "name": "network-vif-plugged", "status": "completed", "tag": "20488b98-4c60-43ee-8d98-91662e03db7f"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:16.939527 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-601cacfb-5edb-4db6-acd7-4c8f79e98eaa req-06fc67cf-ecaf-402a-b73a-5a3b7e331824 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:16.939527 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-601cacfb-5edb-4db6-acd7-4c8f79e98eaa req-06fc67cf-ecaf-402a-b73a-5a3b7e331824 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:16.939527 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-601cacfb-5edb-4db6-acd7-4c8f79e98eaa req-06fc67cf-ecaf-402a-b73a-5a3b7e331824 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:16.950824 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-601cacfb-5edb-4db6-acd7-4c8f79e98eaa req-06fc67cf-ecaf-402a-b73a-5a3b7e331824 service nova] Creating event network-vif-plugged:20488b98-4c60-43ee-8d98-91662e03db7f for instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 on hv-cinder-80152 Oct 14 03:10:16.956149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-601cacfb-5edb-4db6-acd7-4c8f79e98eaa req-06fc67cf-ecaf-402a-b73a-5a3b7e331824 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032492 Oct 14 03:10:16.956744 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 192/383] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:16.966443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:16.971875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-08400cc2-1dc7-44d5-9843-35698ce6ddea tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1472 microversion: 2.1 time: 0.114892 Oct 14 03:10:16.972668 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 192/384] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:16 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1472 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:17.306804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:17.307782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:17.314877 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.315605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.316517 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.318728 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.319361 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.319794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.331557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:17.332721 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:17.339681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.340493 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.341082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.342344 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.343348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.343965 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.544158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.555675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.566648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.566648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-94426d9d-cb32-4c82-b70a-fddcf7e8759e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.257417 Oct 14 03:10:17.578719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 193/385] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:17 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:17.586061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.589953 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:17.603264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-20c4d7bc-7e77-45fc-8869-9f0f5b13e9ea tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.268823 Oct 14 03:10:17.610014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:17.610783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 193/386] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:17 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:17.616416 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.616912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.617349 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.618086 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.618546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.618969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.789285 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:17.807300 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-40dbbeab-af27-4ea6-bf74-e8fc215217d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.228788 Oct 14 03:10:17.815694 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 194/387] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:17 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:17.944768 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:17.945456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:17.952426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.952886 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.953312 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.954022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:17.954468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:17.954883 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:17.995680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:17.996117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.002259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.002747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.003176 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.003867 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.004318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.004736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.037229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.037618 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.042454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.042942 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lazy-loading 'fault' on Instance uuid ffa1b038-3bf4-4429-bd6e-691a1abe5081 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:18.099236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.107527 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0b89ee85-2a55-47e3-9892-4c8c213978d7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1309 microversion: 2.1 time: 0.115826 Oct 14 03:10:18.108185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 195/388] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:17 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:18.117681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.125842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-887b6502-2065-48a5-9c34-659d986ba580 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1564 microversion: 2.1 time: 0.185054 Oct 14 03:10:18.126414 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 194/389] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:17 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:18.150430 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:18.150961 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.157611 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.158123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.158557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.159248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.159704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.160126 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.258098 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-46fbe23f-e817-48e2-bcf9-0c0d50568b1f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111552 Oct 14 03:10:18.258747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 196/390] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Oct 14 03:10:18 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:18.589417 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:18.590050 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.596356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.596873 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.597308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.598033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.598479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.598920 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.618254 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:18.619142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.630174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.634262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.634262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.634262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.634262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.634628 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.819263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.821718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.832165 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7da89737-511a-4fdd-a038-e7ba36441dfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1314 microversion: 2.1 time: 0.217785 Oct 14 03:10:18.833049 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 197/391] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:18 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:18.838843 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:18.842623 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:18.842754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.843990 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:18.845169 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e494ef2c-70d4-49a1-8fff-071bc937db2d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.259661 Oct 14 03:10:18.845692 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:18.846062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 195/392] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:18 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:18.847541 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.848028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.848462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:18.849192 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:18.849647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:18.851718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.004227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:19.024706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-408b0ca6-1485-4115-81f3-4afc90c55a8a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.189607 Oct 14 03:10:19.025291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 198/393] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:18 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:19.132954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:19.133594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:19.140348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.141087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.141524 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.142327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.143075 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.143500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.187753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.188240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.188672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.189118 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lazy-loading 'fault' on Instance uuid ffa1b038-3bf4-4429-bd6e-691a1abe5081 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:19.236959 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:19.245274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-eb73b989-b331-4625-9f14-3daa05d54c3b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1309 microversion: 2.1 time: 0.117808 Oct 14 03:10:19.260355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 196/394] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:19 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:19.476013 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-a4ca4970-4899-4611-889f-39c622aaa365 req-da6da2f1-9505-422f-a0e1-7d255bf118c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07426fa3-a9d9-4304-854a-b6a298b3f8c7", "tag": "04f7e24a-0bec-4456-bb1a-56489e3f78c6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:19.490657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-a4ca4970-4899-4611-889f-39c622aaa365 req-da6da2f1-9505-422f-a0e1-7d255bf118c6 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.491404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-a4ca4970-4899-4611-889f-39c622aaa365 req-da6da2f1-9505-422f-a0e1-7d255bf118c6 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.491980 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-a4ca4970-4899-4611-889f-39c622aaa365 req-da6da2f1-9505-422f-a0e1-7d255bf118c6 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.509559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-a4ca4970-4899-4611-889f-39c622aaa365 req-da6da2f1-9505-422f-a0e1-7d255bf118c6 service nova] Creating event network-changed:04f7e24a-0bec-4456-bb1a-56489e3f78c6 for instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 on hv-cinder-80152 Oct 14 03:10:19.516083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-a4ca4970-4899-4611-889f-39c622aaa365 req-da6da2f1-9505-422f-a0e1-7d255bf118c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046353 Oct 14 03:10:19.525387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 199/395] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:19.873604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:19.874290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:19.881273 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:19.882614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:19.885271 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.886185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.886875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.887782 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.889257 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.889949 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.896788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.897390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.897792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.898504 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:19.898964 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:19.899393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:19.914495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:20.124090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.137988 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.141677 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.144768 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5a8cae67-7512-45f1-b3ae-c3950942de94 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.267648 Oct 14 03:10:20.147252 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 200/396] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:19 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:20.155493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:20.157171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:20.167408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:20.173450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:20.174344 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.175328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:20.176049 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:20.176932 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.189445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.205849 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bec5755a-abdd-4a51-8313-685c6a23f25e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1497 microversion: 2.1 time: 0.338186 Oct 14 03:10:20.223766 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 197/397] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:19 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1497 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:20.272694 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:20.273598 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:20.280898 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:20.281981 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:20.282364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.283376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:20.284062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:20.284709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.338523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:20.343437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:20.343437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:20.343437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lazy-loading 'fault' on Instance uuid ffa1b038-3bf4-4429-bd6e-691a1abe5081 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:20.413020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.422782 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9e13bfa7-b69b-4955-8f75-9fdde50b344f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1309 microversion: 2.1 time: 0.154081 Oct 14 03:10:20.425262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 198/398] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:20 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:20.427712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:20.437217 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-032c521b-e0f7-4595-af14-b0e520e0cfab tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.288757 Oct 14 03:10:20.438697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 201/399] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:20 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:21.175698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:21.177541 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:21.183138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.183630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.184056 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.187623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.188288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.190352 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.378508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.401592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.403939 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.407077 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fb2c0ed4-4d42-4f30-9cb2-21c616e69063 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.235898 Oct 14 03:10:21.409064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 199/400] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:21 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:21.447627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:21.448241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:21.463571 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:21.476816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:21.489452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.489816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.490570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.491263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.492012 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.492646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.493634 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.495029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.495314 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.495922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.496694 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.497112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.595053 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.595913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.596506 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.597229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lazy-loading 'fault' on Instance uuid ffa1b038-3bf4-4429-bd6e-691a1abe5081 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:21.660484 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.671518 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7ab850a6-6a20-4f77-9031-24ea60d51cf5 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 200 len: 1309 microversion: 2.1 time: 0.227931 Oct 14 03:10:21.672665 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 202/401] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:21 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 1309 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:21.677546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:21.678264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:21.684772 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.685490 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.687966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.688879 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:21.689784 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:21.690371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:21.752018 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:10:21.804440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:21.819953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7e1eca5f-5e4c-4f6f-ac73-37dbcf6151b4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.360313 Oct 14 03:10:21.821804 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 200/402] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:21 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:22.054867 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6dcf97bc-78ca-4447-a21a-268240bf258f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "DELETE /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 204 len: 0 microversion: 2.1 time: 0.380714 Oct 14 03:10:22.055511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 203/403] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:10:21 2022] DELETE /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:10:22.064487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:22.067621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:22.072022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.072515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.072954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.073666 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.074163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.074596 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.216550 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:22.225446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c05f1b5a-1a57-4e9b-b49c-51d8033983ce tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1503 microversion: 2.1 time: 0.165254 Oct 14 03:10:22.226057 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 201/404] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:22 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:22.440413 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:22.441029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:22.446941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.447421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.447860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.448546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.448998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.449420 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.453993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:22.580839 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:22.589326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:22.590842 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:22.592054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4bfd5a82-2456-43f5-94d7-c295036d5ddb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.156725 Oct 14 03:10:22.592621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 204/405] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:22 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:22.696184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:22.696712 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: ffa1b038-3bf4-4429-bd6e-691a1abe5081] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:22.702667 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.703145 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.703577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.704257 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.704708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.705128 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.718899 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] HTTP exception thrown: Instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 could not be found. Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Request method failure captured: Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 HTTP/1.1 Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNK4c1ZNMmMaggROfqVnUtypQLXHrSSqX2kbw2pm4AHBdk01-lvwF1Mg34qrANjWTAK-yWcd3nOdxDWwSRCdeIsGRHs_VjhI-d_jfQcTIphliG_tWXEhlTwD5TfOhEaO2x0iiWkoYJqYuXm0ubwlFxYoqh7QNYf94W6TrFLN6xVyfrs Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 9e3dfb4977504552a5480cd375ded7dd Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1275051050 Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:10:22.720508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e3dfb4977504552a5480cd375ded7dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e3dfb4977504552a5480cd375ded7dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e3dfb4977504552a5480cd375ded7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e3dfb4977504552a5480cd375ded7dd"}]}] Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-VolumesSnapshotTestJSON-1275051050 Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 9e3dfb4977504552a5480cd375ded7dd Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1275051050 Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-VolumesSnapshotTestJSON-1275051050-project Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: ced832cf86304814b020de4ed3e0955f Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-VolumesSnapshotTestJSON-1275051050-project Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 could not be found. Oct 14 03:10:22.722089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'ffa1b038-3bf4-4429-bd6e-691a1abe5081'} Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 could not be found. Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:10:22.723110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 could not be found. Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 could not be found. Oct 14 03:10:22.724537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:22.725824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Returning 404 to user: Instance ffa1b038-3bf4-4429-bd6e-691a1abe5081 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:10:22.725824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-04a203c1-d5eb-4d6d-b392-9875b18ca13c tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081" status: 404 len: 111 microversion: 2.1 time: 0.029664 Oct 14 03:10:22.725824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 202/406] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:22 2022] GET /compute/v2.1/servers/ffa1b038-3bf4-4429-bd6e-691a1abe5081 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:10:22.846948 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:22.847551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:22.853954 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.859113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.859113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:22.859113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:22.859113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:22.859501 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:23.005776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:23.032320 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c50be908-951e-42c5-8638-c64d2b2d7a5e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.188952 Oct 14 03:10:23.048930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 205/407] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:22 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:23.249111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:23.249843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:23.258738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:23.259455 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:23.260128 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:23.260827 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:23.261274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:23.261689 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:23.435916 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:23.444639 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-46520a4e-fde4-4625-8200-7d580bd12369 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1503 microversion: 2.1 time: 0.199686 Oct 14 03:10:23.445198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 203/408] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:23 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:23.631994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:23.632731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:23.640429 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:23.641028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:23.641546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:23.642517 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:23.643035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:23.643506 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:23.778060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:23.786308 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:23.787880 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:23.789123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ef2ada66-2a9a-4585-973d-acc322e001bf tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.161371 Oct 14 03:10:23.789672 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 206/409] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:23 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:24.055233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:24.055839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:24.057664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:24.062877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.063355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.063780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.064459 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.064904 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.065322 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.192154 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.200289 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-69f2e1e0-ecea-4b00-8d4d-205a4fc9016c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.148900 Oct 14 03:10:24.201029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 204/410] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:24 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:24.468372 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:24.468901 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:24.474963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.475554 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.475990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.476675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.477122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.477539 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.606026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.613873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2a197f9f-5791-4304-9ae8-17d7564aab8d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1503 microversion: 2.1 time: 0.149821 Oct 14 03:10:24.614436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 207/411] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:24 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:24.815871 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:24.816635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:24.823091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.823575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.824027 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.824711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:24.825162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:24.825582 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:24.950602 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.958613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.960098 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:24.961257 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1777e686-795d-4228-90b0-3aa9da1aafe5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.150062 Oct 14 03:10:24.961833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 205/412] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:24 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:25.224515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:25.225127 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:25.231571 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.232052 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.232485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.233167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.233907 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.234990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.360653 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:25.369061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1558f57c-c067-4878-8f24-612a36d63fc4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.148349 Oct 14 03:10:25.369955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 208/413] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:25 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:25.636576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:25.637206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:25.643772 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.644245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.644670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.645345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.645937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.646355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.773613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:25.781244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9271da86-0929-4e35-b9d3-e46e5daa1d7f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1503 microversion: 2.1 time: 0.148656 Oct 14 03:10:25.781817 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 206/414] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:25 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:25.987547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:25.988067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:25.994014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.994493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.994923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:25.995599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:25.996045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:25.996461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.120144 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.129100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.130570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.131726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-656d913c-28d3-48bf-9f95-e3e2d8feb93b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.148893 Oct 14 03:10:26.132274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 209/415] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:25 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:26.392261 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:26.392865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:26.399380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.399862 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.400292 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.400973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.401420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.401871 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.532382 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.541400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0eeab842-320f-41fb-987b-afd03c1da404 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1723 microversion: 2.1 time: 0.152944 Oct 14 03:10:26.541997 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 207/416] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:26 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:26.803093 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:26.803707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:26.809970 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.810449 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.810977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.811701 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:26.812154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:26.812577 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:26.939584 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:26.947234 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9abc3f71-2254-49de-9ec4-bc19a574e690 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1503 microversion: 2.1 time: 0.148195 Oct 14 03:10:26.947800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 210/417] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:26 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:27.156496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:27.157103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:27.163041 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.163523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.163962 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.164647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.165099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.165520 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.289023 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:27.297032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:27.298500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:27.299662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d3426ed7-839e-485d-b164-cf73354ad767 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1741 microversion: 2.20 time: 0.147123 Oct 14 03:10:27.300222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 208/418] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:27 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1741 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:27.566808 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:27.567428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:27.573442 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.574238 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.574850 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.575579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.576034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.576452 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.715187 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:27.723976 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fe457b32-1007-4f01-870b-263fa306a9bb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1700 microversion: 2.1 time: 0.161860 Oct 14 03:10:27.724791 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 211/419] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:27 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1700 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:27.748986 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b16be493-4178-4a11-aa0f-471262260bc2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:27.756611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b16be493-4178-4a11-aa0f-471262260bc2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.757112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b16be493-4178-4a11-aa0f-471262260bc2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.757523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b16be493-4178-4a11-aa0f-471262260bc2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.818927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b16be493-4178-4a11-aa0f-471262260bc2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Going to try to start instance {{(pid=119283) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 14 03:10:27.971204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:27.971765 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:27.977839 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.978333 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.978765 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:27.979493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:27.979940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:27.980364 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.000318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b16be493-4178-4a11-aa0f-471262260bc2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/action" status: 202 len: 0 microversion: 2.1 time: 0.255152 Oct 14 03:10:28.002134 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 209/420] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:10:27 2022] POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:10:28.015736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:28.016838 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:28.025350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:28.025877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:28.026316 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.027027 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:28.027474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:28.028149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.190465 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.199544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0dae1d20-d988-4d49-b482-7951bf64aef0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1503 microversion: 2.1 time: 0.232603 Oct 14 03:10:28.200137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 212/421] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:27 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:28.216676 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.226190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-351ecc80-bdfa-4342-bf47-64eaa98f2342 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1709 microversion: 2.1 time: 0.219484 Oct 14 03:10:28.226771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 210/422] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:28 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1709 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:28.261587 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-2a4ead54-e556-4eb6-9332-be1e687c46ae req-4c5f30a6-f581-423b-a8c7-d70032eba1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7c6efa-eaaf-42f7-9c36-ddf200f81d73", "name": "network-vif-deleted", "tag": "20488b98-4c60-43ee-8d98-91662e03db7f"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:28.271998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-2a4ead54-e556-4eb6-9332-be1e687c46ae req-4c5f30a6-f581-423b-a8c7-d70032eba1e9 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:28.272455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-2a4ead54-e556-4eb6-9332-be1e687c46ae req-4c5f30a6-f581-423b-a8c7-d70032eba1e9 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:28.272881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-2a4ead54-e556-4eb6-9332-be1e687c46ae req-4c5f30a6-f581-423b-a8c7-d70032eba1e9 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.286069 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-2a4ead54-e556-4eb6-9332-be1e687c46ae req-4c5f30a6-f581-423b-a8c7-d70032eba1e9 service nova] Creating event network-vif-deleted:20488b98-4c60-43ee-8d98-91662e03db7f for instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 on hv-cinder-80152 Oct 14 03:10:28.290878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-2a4ead54-e556-4eb6-9332-be1e687c46ae req-4c5f30a6-f581-423b-a8c7-d70032eba1e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034033 Oct 14 03:10:28.291467 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 213/423] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:28.324566 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:28.325273 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:28.331831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:28.332395 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:28.332924 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.333691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:28.334489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:28.334987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:28.469448 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.478618 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.480139 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:28.481435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5ca66cf1-5f98-49e7-8a83-89ae3b545509 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1723 microversion: 2.20 time: 0.160800 Oct 14 03:10:28.482478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 211/424] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:28 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:29.224109 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:29.224806 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:29.230876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.231362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.231798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.232491 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.232950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.233375 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.252202 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:29.252813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:29.259082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.259562 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.259992 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.260682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.261132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.261551 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.264993 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.265407 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.265860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.266299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lazy-loading 'fault' on Instance uuid be7c6efa-eaaf-42f7-9c36-ddf200f81d73 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:29.308446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.316759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-51760544-5574-4d5f-9b69-aefecfd1b3ec tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1304 microversion: 2.1 time: 0.097432 Oct 14 03:10:29.317332 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 214/425] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:29 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:29.403147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.411965 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-50545c13-3433-458e-977e-10b0bb588fd3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1709 microversion: 2.1 time: 0.164246 Oct 14 03:10:29.412522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 212/426] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:29 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:29.511523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:29.512154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:29.518017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.518438 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.518860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.519530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:29.520053 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:29.520470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:29.646211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.654188 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.655600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:29.657237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4a7bda28-fa36-4c29-8e1c-c19f5daad8b8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1723 microversion: 2.20 time: 0.149622 Oct 14 03:10:29.657800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 215/427] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:29 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:30.339631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:30.340265 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:30.347211 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.347687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.348118 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.348795 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.349245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.349666 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.368469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:30.382369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.382779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.383235 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.383682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lazy-loading 'fault' on Instance uuid be7c6efa-eaaf-42f7-9c36-ddf200f81d73 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:30.426876 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.434400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f89e3e70-77d3-4dec-9ab3-2d6eeda225d8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1304 microversion: 2.1 time: 0.098691 Oct 14 03:10:30.434959 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 213/428] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:30 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:30.435651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:30.436260 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:30.442562 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.443046 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.443523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.444153 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.444609 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.445137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.569815 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.578366 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bf3e8c1c-c25f-47cf-991c-154a84183a23 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1709 microversion: 2.1 time: 0.146131 Oct 14 03:10:30.578910 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 216/429] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:30 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1709 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:30.683194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:30.683803 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:30.690041 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.690520 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.690950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.691632 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:30.692105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:30.692523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:30.817239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.825317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.826779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:30.828413 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cccbe0e8-d412-42a7-b1cf-74dc41379220 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1723 microversion: 2.20 time: 0.148997 Oct 14 03:10:30.828972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 214/430] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:30 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:31.456341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:31.456988 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:31.463436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.463912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.464345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.465027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.465479 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.465927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.496261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.496734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.497168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.497631 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lazy-loading 'fault' on Instance uuid be7c6efa-eaaf-42f7-9c36-ddf200f81d73 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:31.539666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.547701 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3c134288-584a-46ee-abb6-3f58477f1937 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1304 microversion: 2.1 time: 0.095176 Oct 14 03:10:31.548270 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 217/431] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:31 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:31.602111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:31.602722 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:31.609854 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.610337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.610879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.611564 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.612018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.612439 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.736336 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.744461 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ce68e523-8ee4-46b1-9e87-1efaec35ef8b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1709 microversion: 2.1 time: 0.146234 Oct 14 03:10:31.745019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 215/432] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:31 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1709 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:31.854185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:31.854735 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:31.861505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.862015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.862456 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.863143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:31.863602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:31.864026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:31.987992 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.996178 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.997660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:31.998880 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4834a061-940b-422f-8b56-eb9add846e73 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1723 microversion: 2.20 time: 0.148679 Oct 14 03:10:31.999503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 218/433] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:31 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:32.203355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-90ebcc36-a53b-44ab-85ed-6fc55ccab17c req-fb71976b-be60-493d-b1b5-11e04dfe8de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dafdb-f3bf-4f25-96bc-6595e7f52a89", "name": "network-vif-unplugged", "status": "completed", "tag": "e18b99a9-f003-40de-a7b1-30cc36ffa681"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:32.213390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-90ebcc36-a53b-44ab-85ed-6fc55ccab17c req-fb71976b-be60-493d-b1b5-11e04dfe8de3 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.213862 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-90ebcc36-a53b-44ab-85ed-6fc55ccab17c req-fb71976b-be60-493d-b1b5-11e04dfe8de3 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.224714 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-90ebcc36-a53b-44ab-85ed-6fc55ccab17c req-fb71976b-be60-493d-b1b5-11e04dfe8de3 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.225710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-90ebcc36-a53b-44ab-85ed-6fc55ccab17c req-fb71976b-be60-493d-b1b5-11e04dfe8de3 service nova] Creating event network-vif-unplugged:e18b99a9-f003-40de-a7b1-30cc36ffa681 for instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 on hv-cinder-80152 Oct 14 03:10:32.230602 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-90ebcc36-a53b-44ab-85ed-6fc55ccab17c req-fb71976b-be60-493d-b1b5-11e04dfe8de3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031844 Oct 14 03:10:32.231170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 216/434] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:32.571461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:32.572725 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:32.580435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.581217 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.581861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.583204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.583661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.584082 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.617181 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.617931 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.619103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.619706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lazy-loading 'fault' on Instance uuid be7c6efa-eaaf-42f7-9c36-ddf200f81d73 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:32.668502 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:32.677150 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2d1f8a73-6f78-4b9d-bcfb-dc06d349063e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1304 microversion: 2.1 time: 0.109806 Oct 14 03:10:32.678192 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 219/435] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:32 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:32.768341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:32.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:32.775137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.775610 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.776514 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.776756 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:32.777203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:32.777617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:32.903267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:32.911657 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-af093759-5088-485c-bd47-0149bdbcdf7d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1709 microversion: 2.1 time: 0.148035 Oct 14 03:10:32.912225 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 217/436] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:32 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:33.025477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:33.027596 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:33.032118 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.032594 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.033024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.033753 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.034221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.034639 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.049570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:33.160828 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:33.168766 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:33.170213 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:33.171988 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-89690eea-17f2-40b9-b8b0-9a768775f77b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1726 microversion: 2.20 time: 0.150791 Oct 14 03:10:33.172540 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 220/437] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:33 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:33.196431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93f96370-ad94-4396-8933-7112970ff30a"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:33.198910 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:33.204759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.205169 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.205623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.206330 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.207435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.207862 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.308427 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1247708710", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "networks": [{"uuid": "6f9d2079-fec7-4a8b-b52a-3ca108fd76be"}]}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:33.363164 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] validate_networks() for [('6f9d2079-fec7-4a8b-b52a-3ca108fd76be', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:10:33.719127 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:10:33.719645 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:10:33.719971 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:10:33.720370 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:10:33.720770 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:10:33.729504 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.730024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.730455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.731169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.731666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.732087 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.750193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Getting quotas for project 9e3dfb4977504552a5480cd375ded7dd. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:10:33.752511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Getting quotas for user ced832cf86304814b020de4ed3e0955f and project 9e3dfb4977504552a5480cd375ded7dd. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:10:33.763512 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:10:33.766386 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:10:33.916642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b984e73e-70f3-41d3-b66a-dac583463829 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612015 Oct 14 03:10:33.917276 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 221/438] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 03:10:33.926634 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:33.927226 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:33.934903 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.936235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.936235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.936499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.937833 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.937946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.969785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:33.970272 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:33.970705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:33.971162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lazy-loading 'fault' on Instance uuid be7c6efa-eaaf-42f7-9c36-ddf200f81d73 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:10:34.043455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:34.051177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b497a6a9-aed7-4675-b91b-a18a9bfef128 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 200 len: 1304 microversion: 2.1 time: 0.128299 Oct 14 03:10:34.052070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 222/439] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:33 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:34.056661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-41b66038-b091-4035-b173-a79d9b8eadc7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:34.057313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-41b66038-b091-4035-b173-a79d9b8eadc7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:34.130212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-41b66038-b091-4035-b173-a79d9b8eadc7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:34.140895 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-41b66038-b091-4035-b173-a79d9b8eadc7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1219 microversion: 2.1 time: 0.087080 Oct 14 03:10:34.148026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 223/440] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:34 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:34.148709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:34.149474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:34.158272 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.158967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.159552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.160328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.160855 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.161432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.276802 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-eb453598-c4cc-45e0-8958-09ade0c65209 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.084475 Oct 14 03:10:34.277968 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 218/441] 10.222.0.39 () {62 vars in 1364 bytes} [Fri Oct 14 03:10:33 2022] POST /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments => generated 188 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:10:34.329798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:34.340068 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-be6fbc2d-753b-410c-b0d1-cb2f3fd85591 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1713 microversion: 2.1 time: 0.193990 Oct 14 03:10:34.340068 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 224/442] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:34 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1713 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:34.415885 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:34.416479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:34.423655 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.424135 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.424572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.425263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.425717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.426173 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.468842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119283) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 03:10:34.878927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c17fcd4b-7538-4d62-84ac-cc22ecf3c9fe tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/action" status: 202 len: 0 microversion: 2.20 time: 0.466924 Oct 14 03:10:34.879615 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 219/443] 10.222.0.39 () {62 vars in 1319 bytes} [Fri Oct 14 03:10:34 2022] POST /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:10:34.887624 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:34.888229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:34.894618 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.895100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.895532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:34.896295 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:34.896752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:34.897175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.035326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.043949 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.045397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.046758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f0b430d5-bc3b-4483-91a2-2a42784d2935 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1812 microversion: 2.20 time: 0.162999 Oct 14 03:10:35.047313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 225/444] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:34 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:35.074691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:35.076923 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be7c6efa-eaaf-42f7-9c36-ddf200f81d73] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:35.083747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.084264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.084700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.085397 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.085874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.086303 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.102081 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] HTTP exception thrown: Instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 could not be found. Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Request method failure captured: Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 HTTP/1.1 Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNMAj3FFcooDACgdfDS-q-SW3WYH0rfFShITk5sbQPlG7dTS0FkPWE8knY-dI-6QhtymyhURHTAQqBK8xze-TzBvdkTVGOQXLzrHosQnjMCbKl1i0clW0QPbFcNxmrOW2PAOUlRnUVkFGXi3q6fs_ofJIwEKMWOcEPK67hLCDarscyQ Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 57c8543c66ed4a6889a7740932dc6433 Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-VolumesActionsTest-2146584022 Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:10:35.103880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/57c8543c66ed4a6889a7740932dc6433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/57c8543c66ed4a6889a7740932dc6433"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/57c8543c66ed4a6889a7740932dc6433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_57c8543c66ed4a6889a7740932dc6433"}]}] Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-VolumesActionsTest-2146584022 Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 57c8543c66ed4a6889a7740932dc6433 Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-VolumesActionsTest-2146584022 Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-VolumesActionsTest-2146584022-project Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: e9b2d8f2742d4e5a8576e16c122c95ac Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-VolumesActionsTest-2146584022-project Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 could not be found. Oct 14 03:10:35.105720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'be7c6efa-eaaf-42f7-9c36-ddf200f81d73'} Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 could not be found. Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:10:35.106630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 could not be found. Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 could not be found. Oct 14 03:10:35.108183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:10:35.109632 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Returning 404 to user: Instance be7c6efa-eaaf-42f7-9c36-ddf200f81d73 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:10:35.109632 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6956925d-d5b9-42c3-a27e-f7c76b17dd27 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73" status: 404 len: 111 microversion: 2.1 time: 0.035773 Oct 14 03:10:35.109632 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 220/445] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:35 2022] GET /compute/v2.1/servers/be7c6efa-eaaf-42f7-9c36-ddf200f81d73 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:10:35.164759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:35.165375 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:35.172511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.172868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-317481492", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "networks": [{"uuid": "05232e0b-a0d1-419f-aeac-d0342ce1d8bc"}]}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:35.173259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.174157 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.175261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.175822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.176346 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.249370 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] validate_networks() for [('05232e0b-a0d1-419f-aeac-d0342ce1d8bc', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:10:35.252038 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:35.260387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d862d7e7-bd80-4ce2-a54c-4538b7b9e7b6 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1223 microversion: 2.1 time: 0.099098 Oct 14 03:10:35.260937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 226/446] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:35 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:35.830394 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:10:35.830894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:10:35.831429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:10:35.831903 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:10:35.832383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:10:35.845062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.845612 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.846133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.846923 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:35.847380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:35.847915 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:35.866724 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Getting quotas for project 57c8543c66ed4a6889a7740932dc6433. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:10:35.870736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Getting quotas for user e9b2d8f2742d4e5a8576e16c122c95ac and project 57c8543c66ed4a6889a7740932dc6433. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:10:35.882377 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:10:35.885435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:10:36.017247 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2f793da0-c3aa-40b8-8dd6-c518f38c654d tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848105 Oct 14 03:10:36.018150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 221/447] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:10:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:10:36.028973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-59923e70-1bf3-4268-bde1-76998bac709e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:36.029588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-59923e70-1bf3-4268-bde1-76998bac709e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:36.072402 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:36.073023 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:36.083880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.084189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-59923e70-1bf3-4268-bde1-76998bac709e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.084389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.086598 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.088028 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.088489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.090774 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.092651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-59923e70-1bf3-4268-bde1-76998bac709e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1213 microversion: 2.1 time: 0.066970 Oct 14 03:10:36.094241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 227/448] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:36 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:36.239331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.247942 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.249983 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.252014 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bc8ff013-8554-4345-84bf-77f3888d62c8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1752 microversion: 2.20 time: 0.182882 Oct 14 03:10:36.252014 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 222/449] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:36 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:36.283381 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:36.284160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:36.290816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.291380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.291889 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.292651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:36.293177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:36.293665 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:36.353533 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:36.361908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-76e994a7-83da-4085-81d4-5d0cef008e15 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1215 microversion: 2.1 time: 0.082467 Oct 14 03:10:36.362467 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 228/450] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:36 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:37.116687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:37.117308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:37.123279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.123907 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.124433 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.125354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.125831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.126261 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.196226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:37.205036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ffb9fd89-f2c6-4dea-9f1d-af50bdaff695 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1217 microversion: 2.1 time: 0.092448 Oct 14 03:10:37.205832 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 223/451] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:37 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:37.276533 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:37.277227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:37.292196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.292196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.292196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.292196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.293344 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.293344 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.385951 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:37.386559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:37.393045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.393529 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.393978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.394829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:37.395427 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:37.396121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:37.424879 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:37.434662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:37.436192 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:37.438071 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-344e852e-7aeb-4f29-af5e-27fa51fa04bd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1754 microversion: 2.20 time: 0.165011 Oct 14 03:10:37.438776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 229/452] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:37 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:37.458546 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:37.466304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-61e120a6-c8af-4bfe-bfb0-f7924686bd62 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1271 microversion: 2.1 time: 0.084232 Oct 14 03:10:37.466848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 224/453] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:37 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:38.228406 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:38.229040 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:38.235939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.236418 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.236913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.237580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.238233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.238652 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.320544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.330918 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d22ab6cd-720f-4428-ac36-6043de34616f tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1265 microversion: 2.1 time: 0.106272 Oct 14 03:10:38.331658 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 230/454] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:38 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:38.465452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:38.466166 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:38.474453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.474936 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.475540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.476636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.477116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.477535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.489289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:38.490164 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:38.492237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:38.497858 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.498631 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.499156 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.500064 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:38.500705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:38.501488 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:38.586169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.597333 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-716b3a44-0d81-4e29-b536-de9e73de1196 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1277 microversion: 2.1 time: 0.111879 Oct 14 03:10:38.598090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 231/455] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:38 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:38.657881 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.667448 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.668989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:38.670202 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-57616e97-6eba-4f36-b7a7-e9dce5c52df5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1754 microversion: 2.20 time: 0.209840 Oct 14 03:10:38.670751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 225/456] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:38 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:39.354974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:39.355551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:39.363436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.363927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.364362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.365064 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.365516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.365964 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.432013 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.441610 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-eebdf0ba-9826-4158-b608-333555f3c8ef tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1273 microversion: 2.1 time: 0.090085 Oct 14 03:10:39.457625 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 232/457] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:39 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:39.622503 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:39.622503 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:39.629292 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.629787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.630247 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.630932 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.631379 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.631813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.695723 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:39.696330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:39.704304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.705089 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.705547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.706342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:39.706805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:39.707285 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:39.798285 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.808449 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-08b8c81c-b4c7-4768-920e-976d82af84ee tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.190975 Oct 14 03:10:39.809264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 226/458] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:39 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:39.871683 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.883679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.883679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:39.884715 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-18a89b96-0264-4138-a258-206072c183f3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.192943 Oct 14 03:10:39.894350 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 233/459] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:39 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:40.360646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-b723052d-ffbf-4762-85f9-5370c90fc3f1 req-eec6d164-621f-488d-8cd4-2d9deb954ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19d9d10-c7d3-4d5f-b180-0663a2283d54", "tag": "618fd49c-b150-468d-b8f2-201e9a4b4aa8"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:40.394070 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-b723052d-ffbf-4762-85f9-5370c90fc3f1 req-eec6d164-621f-488d-8cd4-2d9deb954ec4 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.394576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-b723052d-ffbf-4762-85f9-5370c90fc3f1 req-eec6d164-621f-488d-8cd4-2d9deb954ec4 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.395008 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-b723052d-ffbf-4762-85f9-5370c90fc3f1 req-eec6d164-621f-488d-8cd4-2d9deb954ec4 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.406532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-b723052d-ffbf-4762-85f9-5370c90fc3f1 req-eec6d164-621f-488d-8cd4-2d9deb954ec4 service nova] Creating event network-changed:618fd49c-b150-468d-b8f2-201e9a4b4aa8 for instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 on hv-cinder-80152 Oct 14 03:10:40.411659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-b723052d-ffbf-4762-85f9-5370c90fc3f1 req-eec6d164-621f-488d-8cd4-2d9deb954ec4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055450 Oct 14 03:10:40.412272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 227/460] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:40.471229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:40.471860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:40.478455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.479028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.479467 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.480199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.480840 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.481273 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.617458 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:40.625455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0f022b69-8e78-4bc7-bf67-bebd56bd4bfa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.164743 Oct 14 03:10:40.626078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 234/461] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:40 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:40.833818 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:40.835055 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:40.841505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.842027 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.842468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.843268 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.844362 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.844791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.912836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:40.913561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:40.920624 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.921709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.922221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:40.923618 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:40.924162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:40.924684 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.012929 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.017000 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:41.021996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e48fd3f0-6ca4-45b2-9c2c-c977a89d8297 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.192847 Oct 14 03:10:41.022568 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 228/462] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:40 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:41.082660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.091282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.092738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.093968 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3fb350d8-0d2b-4d81-bf57-ae370da1af12 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.186885 Oct 14 03:10:41.094529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 235/463] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:40 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:41.648450 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:41.649086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:41.655941 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:41.656429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:41.656861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.657557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:41.658047 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:41.658474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:41.790408 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:41.798933 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0cfd7313-ead1-4323-a14b-470ce468abab tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.154293 Oct 14 03:10:41.799506 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 229/464] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:41 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:42.046351 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:42.047565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:42.054507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.055102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.055614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.056319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.056773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.057316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.119965 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:42.120682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:42.128432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.129972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.130172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.130723 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.131950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.131950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.240149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.248205 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-76c12259-bb3c-44e5-b5ab-0ca26ba12873 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.205873 Oct 14 03:10:42.262110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 236/465] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:42 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:42.302342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.314180 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.317098 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.318516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-29406a0e-4438-4fc0-adc7-ff67ab00236a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.202487 Oct 14 03:10:42.319235 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 230/466] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:42 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:42.447967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-9e012605-5fd3-4769-9ca0-357c97b31e1a req-4f59f7fc-356b-4855-b596-78e2dd4bc5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be136ee8-8ea0-493c-bbf7-62afa57e13e1", "tag": "dedd30c6-33b3-4bfe-9dcb-50c92b51f547"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:42.463170 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-9e012605-5fd3-4769-9ca0-357c97b31e1a req-4f59f7fc-356b-4855-b596-78e2dd4bc5d7 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.463740 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-9e012605-5fd3-4769-9ca0-357c97b31e1a req-4f59f7fc-356b-4855-b596-78e2dd4bc5d7 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.464863 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-9e012605-5fd3-4769-9ca0-357c97b31e1a req-4f59f7fc-356b-4855-b596-78e2dd4bc5d7 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.478294 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-9e012605-5fd3-4769-9ca0-357c97b31e1a req-4f59f7fc-356b-4855-b596-78e2dd4bc5d7 service nova] Creating event network-changed:dedd30c6-33b3-4bfe-9dcb-50c92b51f547 for instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 on hv-cinder-80152 Oct 14 03:10:42.483938 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-9e012605-5fd3-4769-9ca0-357c97b31e1a req-4f59f7fc-356b-4855-b596-78e2dd4bc5d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039955 Oct 14 03:10:42.484565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 237/467] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:42.821882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:42.822506 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:42.829121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.829603 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.830122 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.830811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:42.831279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:42.831697 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:42.959590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:42.967413 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-51b18833-a81a-4ddb-b823-510708b72116 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.149365 Oct 14 03:10:42.967977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 231/468] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:42 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:43.272230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:43.272854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:43.278972 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.279453 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.279885 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.280569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.281529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.281975 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.345080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:43.345867 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:43.352222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.352971 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.353405 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.354134 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.354588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.355013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.437533 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:43.445261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d5271d27-d0d1-44c7-8bde-6eb02006fe48 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.177775 Oct 14 03:10:43.445957 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 238/469] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:43 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:43.506001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:43.515091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:43.516573 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:43.517845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f257ff5b-6cd6-4bdc-8773-4031b5528b4f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.177148 Oct 14 03:10:43.522118 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 232/470] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:43 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:43.990106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:43.990627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:43.992588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:43.997635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:43.998158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:43.998600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:43.999299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.000274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.000697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.136951 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.146011 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-410e4847-f7e8-4472-bf1f-8236fc0b1334 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.159783 Oct 14 03:10:44.146578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 239/471] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:43 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:44.468162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:44.468813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:44.475511 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.475997 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.476479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.477171 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.477728 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.478319 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.544030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:44.544797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:44.552567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.553200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.553638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.554385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:44.554834 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:44.555251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:44.559531 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:44.633321 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.642688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-dce8bf00-d675-4ae2-be04-5b2b1c536bad tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.178300 Oct 14 03:10:44.643460 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 233/472] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:44 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:44.718655 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.728304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.729780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:44.731021 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f986b4e4-8957-43cc-b7d3-5d1653a31422 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.190984 Oct 14 03:10:44.731637 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 240/473] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:44 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:45.168403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:45.169016 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:45.175012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.175500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.175937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.176644 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.177093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.177516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.310713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.318790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c0d78453-f75b-4e00-b11d-b7549f517a45 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.154159 Oct 14 03:10:45.319364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 234/474] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:45 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:45.665973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:45.666700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:45.673794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.674295 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.674732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.675436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.675892 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.676318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.756738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:45.757456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:45.764406 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.764963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.765468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.766265 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:45.766801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:45.767300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:45.845158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.853805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ba0f90a8-4849-4297-84a7-54a4336df3ac tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.191858 Oct 14 03:10:45.854523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 241/475] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:45 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:45.855257 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:45.878200 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:45.915197 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.924575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.926103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:45.927281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7a508ceb-16c5-4666-a5a0-72aaf7410b27 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.174433 Oct 14 03:10:45.927837 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 235/476] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:45 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:46.343360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:46.344161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:46.346135 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=10 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:46.351054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.351657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.352167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.352953 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.353549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.354078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.492950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:46.501080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e7d19e66-61ee-4a9b-956f-b12ee32918bd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.161783 Oct 14 03:10:46.501644 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 242/477] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:46 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:46.878783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:46.879515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:46.886100 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.886581 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.887008 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.887707 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.888155 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.888595 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.952572 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:46.954034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:46.962405 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.963505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.963955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:46.964697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:46.965163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:46.965589 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.105491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.116937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3b35bd0b-20ef-43c0-bfe9-65a7668622b7 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.242546 Oct 14 03:10:47.117960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 236/478] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:46 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:47.163792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.173618 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.175186 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.176376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-250a3e4c-2edc-49e0-83f7-5d0f3bc6a67b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.227792 Oct 14 03:10:47.176943 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 243/479] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:46 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:47.523693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:47.524297 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:47.530704 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.531116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.531612 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.532304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:47.532753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:47.533168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:47.693030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:47.701416 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0db323e8-f1c3-4f93-aec6-8db1a9d9df42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.181498 Oct 14 03:10:47.702977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 237/480] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:47 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:48.145840 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:48.147092 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:48.154250 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.154812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.155245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.156667 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.157197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.157610 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.202078 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:48.203880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:48.210278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.211048 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.211643 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.212519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.213122 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.213709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.351834 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.360606 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a97a0ad0-59ee-44d9-bb5d-cec0d126ef5a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.218541 Oct 14 03:10:48.361380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 244/481] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:48 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:48.388954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.399693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.401644 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.403738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fe608ef3-a5b5-4589-b787-fa4659847dc1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.205436 Oct 14 03:10:48.404292 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 238/482] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:48 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:48.724525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:48.725201 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:48.731542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.732851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.732851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.733183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.733946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.734450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.888293 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-1f02c389-49ab-4efb-8000-92f0420559d4 req-10ff633b-8c7e-4d08-a227-a01706780fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19d9d10-c7d3-4d5f-b180-0663a2283d54", "name": "network-vif-plugged", "status": "completed", "tag": "618fd49c-b150-468d-b8f2-201e9a4b4aa8"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:48.891690 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:48.898181 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-1f02c389-49ab-4efb-8000-92f0420559d4 req-10ff633b-8c7e-4d08-a227-a01706780fda service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:48.898516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-1f02c389-49ab-4efb-8000-92f0420559d4 req-10ff633b-8c7e-4d08-a227-a01706780fda service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:48.898938 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-1f02c389-49ab-4efb-8000-92f0420559d4 req-10ff633b-8c7e-4d08-a227-a01706780fda service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:48.900121 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-be943c63-a7ce-487e-8e49-1c18457644f2 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.179508 Oct 14 03:10:48.904812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 245/483] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:48 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:48.911072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-1f02c389-49ab-4efb-8000-92f0420559d4 req-10ff633b-8c7e-4d08-a227-a01706780fda service nova] Creating event network-vif-plugged:618fd49c-b150-468d-b8f2-201e9a4b4aa8 for instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 on hv-cinder-80152 Oct 14 03:10:48.916355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-1f02c389-49ab-4efb-8000-92f0420559d4 req-10ff633b-8c7e-4d08-a227-a01706780fda service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 Oct 14 03:10:48.916962 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 239/484] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:10:49.383421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:49.384036 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:49.390545 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.391039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.391474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.392173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.392627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.393052 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.436318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:49.438066 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:49.444131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.444622 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.445053 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.445976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.446430 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.446850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.592834 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.601627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c4c55128-5307-4c54-90a5-c573350a6797 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.222056 Oct 14 03:10:49.602615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 246/485] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:49 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:49.623459 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.632270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.635275 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:49.636407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ee4ceb63-d484-4ecc-a40d-7f2a0da144dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.205508 Oct 14 03:10:49.636966 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 240/486] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:49 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:49.924306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:49.924839 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:49.930823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.931306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.931743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:49.932496 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:49.933017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:49.933451 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.062411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.071758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7d81fd32-c607-4275-be7c-173523ff2652 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.151311 Oct 14 03:10:50.072342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 247/487] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:49 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:50.626431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:50.627428 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:50.634094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.634606 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.635038 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.635723 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.636193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.636611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.662432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:50.663032 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:50.669288 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.669793 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.670237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.670984 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:50.672045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:50.672475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:50.828103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.837536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0639de60-184c-490a-a186-2edf65f3ad7e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.213536 Oct 14 03:10:50.837536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 241/488] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:50 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:50.850161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.859736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.861193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:50.862409 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-94cd35bc-b372-4012-a763-d5426dd588a2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.203921 Oct 14 03:10:50.862974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 248/489] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:50 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:51.114583 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:51.115230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:51.121234 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.121719 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.122182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.122876 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.123328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.123746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.267061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:51.274791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ee2e7797-d125-4020-a9d9-de974326463a tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.164230 Oct 14 03:10:51.275553 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 242/490] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:51 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:51.859445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:51.860033 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:51.866654 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.867131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.867561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.868256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.868726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.869122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.887182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:51.887801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:51.893515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:51.895633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.895939 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.896383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:51.897082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:51.897541 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:51.897997 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.054779 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.062646 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b05d9dd6-6fb5-41bd-a053-a3e5f899573f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.207710 Oct 14 03:10:52.074637 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 249/491] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:51 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:52.081902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.090848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.092291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.094023 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2467ed39-5f8c-4a4b-b771-2e9ebcac24dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.210713 Oct 14 03:10:52.094898 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 243/492] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:51 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:52.296969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:52.297530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:52.303794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.304290 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.304896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.305447 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:52.305941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:52.306376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:52.442724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:52.450451 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a84682e3-3c07-4d23-a928-865fda0aae99 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.157681 Oct 14 03:10:52.463978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 250/493] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:52 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:53.085872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:53.086471 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:53.094070 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.094783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.095224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.095924 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.096389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.096847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.120823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:53.121411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:53.135270 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.136103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.136739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.137660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.138330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.138942 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.292215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.301080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-baa7fc5f-93d3-49eb-9c7b-2333f80b5d58 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.219048 Oct 14 03:10:53.302067 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 244/494] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:53 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:53.322398 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.331312 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.332701 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.333990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-25ee8b66-aae5-4f8c-bac6-68713d0639a0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.217403 Oct 14 03:10:53.334935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 251/495] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:53 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:53.474610 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:53.475462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:53.482005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.482482 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.483146 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.484751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:53.485373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:53.486162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:53.615932 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:53.624551 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-24dbbb15-3b28-4fa5-9078-7c3bf168f2bb tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.153832 Oct 14 03:10:53.625123 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 245/496] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:53 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:54.325286 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:54.325941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:54.333804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.333984 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.337709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.337709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.337709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.337709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.359896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:54.360500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:54.367072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.367554 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.367990 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.368711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.369165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.369587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.373692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:54.543829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.547434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.551486 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7c9bd870-a0f8-44b6-ac78-43f6529f93dd tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.230312 Oct 14 03:10:54.552049 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 252/497] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:54 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:54.556480 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.558159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.559321 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1518f48d-d49f-4af9-a986-48cc888c6c1b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.203692 Oct 14 03:10:54.559950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 246/498] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:54 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:54.646566 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:54.647130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:54.652996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.653475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.653941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.654625 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:54.655070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:54.656043 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:54.783816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:54.791665 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6d21f738-ca2f-48c3-b8a3-2e458f69d9ac tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.148876 Oct 14 03:10:54.792266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 253/499] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:54 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:55.574481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:55.575138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:55.582434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.582924 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.583365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.584063 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.584521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.584623 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:55.585031 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.585216 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:55.591557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.592029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.592465 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.593149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.593601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.594049 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.809270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:55.817195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:55.817535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-51e52eef-2e54-4971-b911-5d54a6790593 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.246954 Oct 14 03:10:55.818139 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 247/500] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:55 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:55.822664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:55.823264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:55.826519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:55.827987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:55.829156 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fcf5866b-30ec-45e7-a1bb-54e4d202c5ba tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.248714 Oct 14 03:10:55.829704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 254/501] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:55 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:10:55.829919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.830561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.831003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.831701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:55.832154 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:55.832577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:55.967450 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:55.975749 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-099cbe0a-22c9-47c6-a783-7d27b7a027f8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.156649 Oct 14 03:10:55.976342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 248/502] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:55 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:56.840766 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:56.841380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:56.847865 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:56.848339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:56.848774 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:56.849463 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:56.850023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:56.850448 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:56.854754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:56.855360 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:56.862171 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:56.862647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:56.863072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:56.863754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:56.864197 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:56.864631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.039317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:57.047650 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e373dc53-3bbb-4795-913d-d9d85dd3dde8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1319 microversion: 2.1 time: 0.210681 Oct 14 03:10:57.049775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 255/503] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:56 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:57.052944 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:57.053614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:57.058542 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:57.060174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.060660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.061282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.062536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.063006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.063405 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.069333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:57.070879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:57.072156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a874e9b1-d462-4e18-bf64-f3d93a958794 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.221278 Oct 14 03:10:57.072868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 249/504] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:56 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:57.078212 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:57.078874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:57.084938 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.085510 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.086058 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.086811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.087332 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.087823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.088436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3eb51bb1-ebea-4bd9-8b18-ad13ef67cb17 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844/ips" status: 200 len: 149 microversion: 2.1 time: 0.039200 Oct 14 03:10:57.089013 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 256/505] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:10:57 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:10:57.100771 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e807d28-dde3-48d0-91ce-1ade4084204b"}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:57.103301 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:57.109729 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.110246 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.110683 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.111379 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.111836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.112271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.116680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:57.193261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Invalid volume: volume 6e807d28-dde3-48d0-91ce-1ade4084204b is already attached to instances: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: POST /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844/os-volume_attachments HTTP/1.1 Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 74 Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:10:57.197227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {"volumeAttachment": {"volumeId": "6e807d28-dde3-48d0-91ce-1ade4084204b"}} Oct 14 03:10:57.198913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Invalid volume: volume 6e807d28-dde3-48d0-91ce-1ade4084204b is already attached to instances: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'server_id': '174ff84e-3115-4222-a659-4725858ef844', 'body': {'volumeAttachment': {'volumeId': '6e807d28-dde3-48d0-91ce-1ade4084204b'}}} Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6e807d28-dde3-48d0-91ce-1ade4084204b is already attached to instances: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:10:57.199780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6e807d28-dde3-48d0-91ce-1ade4084204b is already attached to instances: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:10:57.201291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:10:57.202762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:10:57.202762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:10:57.202762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:10:57.202762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6e807d28-dde3-48d0-91ce-1ade4084204b is already attached to instances: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e Oct 14 03:10:57.202762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:10:57.202762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 400 to user: Invalid volume: volume 6e807d28-dde3-48d0-91ce-1ade4084204b is already attached to instances: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:10:57.202762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3e0696b6-ad2b-4ca9-86b5-cad1f572ee53 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101889 Oct 14 03:10:57.202762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 257/506] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:10:57 2022] POST /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 14 03:10:57.207627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:57.208119 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:57.213955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.214435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.214872 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.215560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.216007 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.216426 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.221402 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:57.229109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-581691c0-16bc-4a15-8bc6-5b5c4b0b0cfc tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.155166 Oct 14 03:10:57.229669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 250/507] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:57 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:57.242895 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:10:57.503087 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-afd20116-9e21-4155-a176-100d6484ad71 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 204 len: 0 microversion: 2.1 time: 0.298837 Oct 14 03:10:57.503585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 258/508] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:10:57 2022] DELETE /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:10:57.511881 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:57.512595 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:57.519341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.519828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.520261 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.520948 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:57.521401 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:57.521849 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:57.646920 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:57.654598 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-68937752-628d-4062-b8e8-4c2d553305dd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1681 microversion: 2.1 time: 0.146606 Oct 14 03:10:57.655825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 251/509] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:57 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:58.071474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:58.072170 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:58.078780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.079362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.079811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.080498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.080954 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.081374 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.097831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:58.098437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:58.104757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.105222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.105653 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.106379 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.106826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.107247 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.264233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:58.272578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c7f48688-8b77-485b-a5c2-a67d793e5259 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1508 microversion: 2.1 time: 0.205383 Oct 14 03:10:58.273133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 259/510] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:58 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:58.286319 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:58.288575 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:58.289180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:58.295057 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.295530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.296523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.297167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.297614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.298038 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:58.298155 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.299480 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:58.300656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5f6904a9-00cb-46be-add1-c5363cceb87c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.206730 Oct 14 03:10:58.301235 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 252/511] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:58 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:58.306064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f823fd16-7e9d-471a-9efc-45a24c7cd56b", "device": "/dev/sdb"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:10:58.308686 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:58.316211 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.316877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.317502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.318236 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.318695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.319149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.432104 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:58.440734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2633abb1-9bba-4393-8266-9e31d67c99ed tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.156008 Oct 14 03:10:58.441291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 260/512] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:58 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:58.678334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:58.678940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:58.684982 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.685467 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.685929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.686620 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:58.687098 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:58.687519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:58.813537 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:58.821232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-33dffa13-1bdb-48e8-80ba-d79cbdc7d8db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1681 microversion: 2.1 time: 0.146708 Oct 14 03:10:58.821811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 261/513] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:58 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:10:59.326742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:59.327861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:59.334238 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.334717 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.335149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.335838 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.336294 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.336706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.462817 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:59.469163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:59.470645 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:59.471805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-340ba047-d59a-4b0c-8263-9b67f1e2f465 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.148964 Oct 14 03:10:59.472356 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 262/514] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:10:59 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:10:59.476732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:59.477335 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:59.482912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.483642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.484112 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.484800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.485255 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.485679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.614146 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:59.621723 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8d3266a6-f81a-45a5-9d1e-0348b7e15c62 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.148423 Oct 14 03:10:59.622289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 263/515] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:59 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:10:59.844488 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:10:59.845152 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:10:59.851035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.851645 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.852076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.852753 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:10:59.853227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:10:59.853928 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:10:59.981825 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:10:59.989008 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-06487f47-a5e9-4c85-bfb1-6ec4070013ad tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1681 microversion: 2.1 time: 0.148617 Oct 14 03:10:59.989573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 264/516] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:10:59 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:00.496518 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:00.497240 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:00.503832 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:00.504316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:00.504752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:00.505457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:00.505951 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:00.506379 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:00.639217 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:00.648404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:00.649967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:00.651160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-eafe0f1b-2187-4afa-93d9-55c2bf22c3fd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.158656 Oct 14 03:11:00.651722 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 265/517] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:00 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:11:00.656678 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:00.658697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:00.662872 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:00.663354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:00.663794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:00.664501 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:00.664960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:00.665384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:00.795266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:00.802938 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f146650d-edc9-436f-99dd-c9493532c706 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.150227 Oct 14 03:11:00.803510 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 266/518] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:00 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:00.924232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-966bb413-e89a-4b50-9c33-597ed163f1f8 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "POST /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.621728 Oct 14 03:11:00.924839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 253/519] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:10:58 2022] POST /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54/os-volume_attachments => generated 194 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:01.013870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:01.015064 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:01.020930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.021406 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.021942 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.022648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.023083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.023494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.151729 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:01.159620 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-983dfbdf-1e5a-4c2c-9a67-7f1f0f6e95de tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1681 microversion: 2.1 time: 0.149463 Oct 14 03:11:01.160494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 267/520] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:01 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:01.679433 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:01.680054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:01.686361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.686850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.687288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.687989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.688443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.688866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.823516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:01.825732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:01.826377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:01.833113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:01.833604 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.834137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.834572 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.835036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:01.835276 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:01.835914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:01.836468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ca6ba015-65fb-475b-aa85-75ffb941ff3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.161862 Oct 14 03:11:01.836585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:01.837110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 254/521] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:01 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:01.967199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:01.975891 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8ba4438b-6295-4ed9-9c45-594fa05a2ff5 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.153954 Oct 14 03:11:01.976468 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 268/522] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:01 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:02.182023 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:02.184863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:02.189291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.189779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.190240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:02.190935 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.191384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.191808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:02.260275 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:02.268575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ae802966-fa81-46d4-a923-0847f09403e2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1613 microversion: 2.1 time: 0.090528 Oct 14 03:11:02.273961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 255/523] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:02 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:02.474709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-8239e01a-61b5-4c7e-b77c-88b257d808d4 req-14ecda3a-6dcf-492e-a15e-95355631f7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174ff84e-3115-4222-a659-4725858ef844", "name": "network-vif-deleted", "tag": "c0076cbe-9dc5-4a27-b4f0-6470011daec6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:02.484588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8239e01a-61b5-4c7e-b77c-88b257d808d4 req-14ecda3a-6dcf-492e-a15e-95355631f7a1 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.494181 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8239e01a-61b5-4c7e-b77c-88b257d808d4 req-14ecda3a-6dcf-492e-a15e-95355631f7a1 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.494727 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8239e01a-61b5-4c7e-b77c-88b257d808d4 req-14ecda3a-6dcf-492e-a15e-95355631f7a1 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:02.506881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-8239e01a-61b5-4c7e-b77c-88b257d808d4 req-14ecda3a-6dcf-492e-a15e-95355631f7a1 service nova] Creating event network-vif-deleted:c0076cbe-9dc5-4a27-b4f0-6470011daec6 for instance 174ff84e-3115-4222-a659-4725858ef844 on hv-cinder-80152 Oct 14 03:11:02.512122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-8239e01a-61b5-4c7e-b77c-88b257d808d4 req-14ecda3a-6dcf-492e-a15e-95355631f7a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041173 Oct 14 03:11:02.512883 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 269/524] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:02.863734 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:02.864729 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:02.872349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.873095 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.878165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:02.879817 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:02.880539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:02.881127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.008455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:03.010334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:03.025771 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.028174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.028618 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.029339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.032158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.032876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.055723 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:03.066573 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:03.068302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:03.069918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f1419621-a0ee-477c-833d-edeccb1278b1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.210511 Oct 14 03:11:03.071020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 256/525] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:02 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:03.264887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:03.275106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cd00bd82-1883-4e8a-acf2-0e5562b7fb7e tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.278978 Oct 14 03:11:03.275821 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 270/526] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:02 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:03.294006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:03.294771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:03.302460 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.303183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.303729 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.304666 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.305577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.306650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.344164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.344797 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.345385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.345996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid 174ff84e-3115-4222-a659-4725858ef844 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:03.391966 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:03.403186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e22535e5-584e-4068-b357-095d852be617 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 200 len: 1331 microversion: 2.1 time: 0.113352 Oct 14 03:11:03.403871 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 257/527] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:03 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:03.522830 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-d2a66a35-9af7-4e33-afdd-5db1166c567e req-fccf4864-ef7a-414b-bbe8-973be214c271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be136ee8-8ea0-493c-bbf7-62afa57e13e1", "name": "network-vif-plugged", "status": "completed", "tag": "dedd30c6-33b3-4bfe-9dcb-50c92b51f547"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:03.530029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-d2a66a35-9af7-4e33-afdd-5db1166c567e req-fccf4864-ef7a-414b-bbe8-973be214c271 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:03.530507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-d2a66a35-9af7-4e33-afdd-5db1166c567e req-fccf4864-ef7a-414b-bbe8-973be214c271 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:03.530938 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-d2a66a35-9af7-4e33-afdd-5db1166c567e req-fccf4864-ef7a-414b-bbe8-973be214c271 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:03.542305 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-d2a66a35-9af7-4e33-afdd-5db1166c567e req-fccf4864-ef7a-414b-bbe8-973be214c271 service nova] Creating event network-vif-plugged:dedd30c6-33b3-4bfe-9dcb-50c92b51f547 for instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 on hv-cinder-80152 Oct 14 03:11:03.552026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-d2a66a35-9af7-4e33-afdd-5db1166c567e req-fccf4864-ef7a-414b-bbe8-973be214c271 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035993 Oct 14 03:11:03.552649 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 271/528] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:04.097103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:04.097874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:04.105287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.106061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.106674 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.107557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.108298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.109848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.254466 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:04.264182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:04.266185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:04.267358 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4a8512e0-86ca-4722-8c65-1c65f7f1d7d1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.174793 Oct 14 03:11:04.268230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 258/529] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:04 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:04.300791 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:04.301430 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:04.307563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.308045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.308484 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.309195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.309651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.310111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.425982 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:04.426607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:04.432894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.433388 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.433820 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.434500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:04.434942 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:04.435355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:04.441918 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:04.449802 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-58c5c2aa-1a4e-475c-aaad-c9834285eb42 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.153637 Oct 14 03:11:04.450424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 272/530] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:04 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:04.464665 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 HTTP/1.1 Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:11:04.466343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:11:04.467868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '174ff84e-3115-4222-a659-4725858ef844'} Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:11:04.469364 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:11:04.470811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:04.472054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:11:04.472054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-170f23fe-a8c5-486d-9141-4d2549302a97 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 404 len: 111 microversion: 2.1 time: 0.045645 Oct 14 03:11:04.472054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 259/531] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:04 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:11:04.481398 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-018c4e12-022c-4b14-bdcd-f08e81da695d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '.version_select at 0x7f2beb94fb80>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:04.569150 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-018c4e12-022c-4b14-bdcd-f08e81da695d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-314747716" status: 202 len: 0 microversion: 2.1 time: 0.092096 Oct 14 03:11:04.569852 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 273/532] 10.222.0.39 () {58 vars in 1218 bytes} [Fri Oct 14 03:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-314747716 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:11:04.994010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbbcc886-4126-4672-933f-d7e590a1c90e"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:04.996767 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:05.006565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.006565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.006565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.006565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.007015 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.007015 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.296097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:05.299201 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:05.309218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.310414 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.310978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.311690 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.312263 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.314414 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.335560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:05.457834 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:05.466728 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:05.469097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:05.469955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5dfc1377-7496-4d87-a493-15fb0e94ed9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.181377 Oct 14 03:11:05.470506 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 274/533] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:05 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:11:05.475047 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:05.475529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:05.481485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.481999 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.482429 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.483111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.483851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.484819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.564239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'services' on Instance uuid 73287e1d-7bf7-4ebb-93e4-7e16bd29655e {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:05.739310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d15a16e1-bee2-4cc2-bd36-66d57ee68d2b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments/6e807d28-dde3-48d0-91ce-1ade4084204b" status: 202 len: 0 microversion: 2.1 time: 0.267525 Oct 14 03:11:05.739857 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 275/534] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:11:05 2022] DELETE /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments/6e807d28-dde3-48d0-91ce-1ade4084204b => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:11:05.744741 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:05.745470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:05.751521 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.752003 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.752439 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.753123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.753578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.754054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.879933 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:05.887539 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1001f653-b21d-48eb-a217-3dedcee32ba8 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1313 microversion: 2.1 time: 0.146593 Oct 14 03:11:05.888092 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 276/535] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:05 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:05.892939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-c0efc4ce-0e46-421c-873d-3f50a9998e65 req-194b6024-9aba-46fd-bc7b-c466eabb639e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dafdb-f3bf-4f25-96bc-6595e7f52a89", "name": "network-vif-plugged", "status": "completed", "tag": "e18b99a9-f003-40de-a7b1-30cc36ffa681"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:05.897542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:05.902721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-c0efc4ce-0e46-421c-873d-3f50a9998e65 req-194b6024-9aba-46fd-bc7b-c466eabb639e service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.903198 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-c0efc4ce-0e46-421c-873d-3f50a9998e65 req-194b6024-9aba-46fd-bc7b-c466eabb639e service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.903626 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-c0efc4ce-0e46-421c-873d-3f50a9998e65 req-194b6024-9aba-46fd-bc7b-c466eabb639e service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.915039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-c0efc4ce-0e46-421c-873d-3f50a9998e65 req-194b6024-9aba-46fd-bc7b-c466eabb639e service nova] Creating event network-vif-plugged:e18b99a9-f003-40de-a7b1-30cc36ffa681 for instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 on hv-cinder-80152 Oct 14 03:11:05.919776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-c0efc4ce-0e46-421c-873d-3f50a9998e65 req-194b6024-9aba-46fd-bc7b-c466eabb639e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030567 Oct 14 03:11:05.920378 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 277/536] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:05.925406 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:05.927685 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:05.934275 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.934770 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.935186 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.935866 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:05.936319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:05.936737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:05.967694 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-093e34c3-6b50-40da-9065-b85c243783d1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046177 Oct 14 03:11:05.968240 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 278/537] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:11:05 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:06.437042 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:06.496938 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:06.497540 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:06.504896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.505379 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.505847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.506540 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.507021 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.507447 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.639834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bab57364-5a4d-4809-9be4-0039aa875377 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.649654 Oct 14 03:11:06.640695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 260/538] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:11:04 2022] POST /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments => generated 194 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:06.644326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:06.651989 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:06.653827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:06.655290 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b8aef3ad-8421-4b4c-b877-36b491278432 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.162103 Oct 14 03:11:06.657411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 279/539] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:06 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:11:06.912150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:06.912773 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:06.919418 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.919912 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.920350 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.921043 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.921501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.922498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.981000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:06.983314 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:06.990219 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.990701 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.991413 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:06.991836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:06.992282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:06.992696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:07.034347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-dba8780b-f5c8-4efc-a25a-b8367234b3f4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057621 Oct 14 03:11:07.034914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 280/540] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:11:06 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:11:07.055102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:07.062731 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3e18b971-4fbd-44ff-a094-5faa4b64bd2c tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1496 microversion: 2.1 time: 0.155353 Oct 14 03:11:07.063286 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 261/541] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:06 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:07.683352 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:07.684786 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:07.690934 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:07.691497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:07.691928 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:07.692606 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:07.693053 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:07.693582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:07.822426 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:07.831655 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:07.833475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:07.834666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4982ba95-bbea-4018-9c9a-738da56358a1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.155204 Oct 14 03:11:07.835221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 281/542] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:07 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:08.047352 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:08.049656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:08.056240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.056722 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.057158 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.057878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.058333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.063001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.085064 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:08.085592 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:08.088601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bd3ef44f-09e4-43fe-9a8b-96c15719f740 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045945 Oct 14 03:11:08.089164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 262/543] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:11:08 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:08.091535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.092022 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.092464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.093163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.093620 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.094076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.118789 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:11:08.342564 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9080cd1c-57c9-425a-83b0-26f26341f923 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "DELETE /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 204 len: 0 microversion: 2.1 time: 0.261312 Oct 14 03:11:08.345597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 282/544] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:11:08 2022] DELETE /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:11:08.351604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:08.352290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:08.358647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.359757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.360203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.360886 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.361341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.361784 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.487325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:08.495256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-571186bd-c80d-42cc-89fa-58886f593bc3 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1502 microversion: 2.1 time: 0.147419 Oct 14 03:11:08.495812 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 263/545] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:08 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:08.860632 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:08.861417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:08.869529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.870125 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.870568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:08.873854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:08.873854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:08.873854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.013570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:09.022860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:09.029424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:09.029424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4759dff1-c1e2-4ec2-a4ce-d9622a2aa968 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.169773 Oct 14 03:11:09.029424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 283/546] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:08 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:09.100944 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:09.103140 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:09.109712 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:09.110226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:09.110662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.111349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:09.111800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:09.112222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.142786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8e9d1060-e890-4433-8678-1ad05a9ce4a3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Oct 14 03:11:09.143352 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 264/547] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:11:09 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:09.518593 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:09.520144 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:09.526607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:09.527223 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:09.527889 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.528694 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:09.529444 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:09.530009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:09.667230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:09.675819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b30b2699-4b53-494c-af59-333e77d62e26 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1502 microversion: 2.1 time: 0.161291 Oct 14 03:11:09.676385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 284/548] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:09 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:10.052034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:10.052638 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:10.058657 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.059141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.059575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.060298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.060745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.061162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.154836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:10.157557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:10.163936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.164422 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.164858 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.165552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.166031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.166456 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.186110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:10.194567 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:10.195994 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:10.196486 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-195c4ddd-a72f-452e-ad1a-2b83037c794b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Oct 14 03:11:10.197240 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 285/549] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:11:10 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:10.197377 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fc889c6d-4fb2-4200-b6b9-cdd0acb6165b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.149013 Oct 14 03:11:10.197862 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 265/550] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:10 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:10.699619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:10.700235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:10.706172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.706655 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.707094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:10.707782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:10.708239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:10.708666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.046910 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:11.054735 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c49d38d6-b0b4-4184-902c-66f271ddd4aa tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1502 microversion: 2.1 time: 0.359011 Oct 14 03:11:11.055296 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 286/551] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:10 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1502 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:11.209393 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:11.211588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:11.218263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.219302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.219738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.220438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.220889 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.221308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.224424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:11.225035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:11.232102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.232721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.233158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.234310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:11.234758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:11.235176 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:11.254337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-58ab7257-3b0a-4886-8724-e50c34c9abdb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048945 Oct 14 03:11:11.255291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 266/552] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:11:11 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:11.362797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:11.371534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:11.372990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:11.374188 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8bc502de-7815-4349-aa74-1b5a2534bee1 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1810 microversion: 2.20 time: 0.154649 Oct 14 03:11:11.375224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 287/553] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:11 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:11:12.077588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:12.078492 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:12.084734 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.085339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.085906 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.086677 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.087201 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.087825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.123698 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-6e992ab1-8049-4744-889a-2b49d8251538 req-4054738c-a39a-43ad-ae67-2827411694dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be136ee8-8ea0-493c-bbf7-62afa57e13e1", "name": "network-vif-deleted", "tag": "dedd30c6-33b3-4bfe-9dcb-50c92b51f547"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:12.133687 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-6e992ab1-8049-4744-889a-2b49d8251538 req-4054738c-a39a-43ad-ae67-2827411694dd service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.134198 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-6e992ab1-8049-4744-889a-2b49d8251538 req-4054738c-a39a-43ad-ae67-2827411694dd service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.134616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-6e992ab1-8049-4744-889a-2b49d8251538 req-4054738c-a39a-43ad-ae67-2827411694dd service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.145423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-6e992ab1-8049-4744-889a-2b49d8251538 req-4054738c-a39a-43ad-ae67-2827411694dd service nova] Creating event network-vif-deleted:dedd30c6-33b3-4bfe-9dcb-50c92b51f547 for instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 on hv-cinder-80152 Oct 14 03:11:12.150803 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-6e992ab1-8049-4744-889a-2b49d8251538 req-4054738c-a39a-43ad-ae67-2827411694dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030608 Oct 14 03:11:12.151347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 288/554] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:11:12.153500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:12.161906 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2908a28a-c0c3-4c4a-baa6-0d4fe9b9ef09 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1460 microversion: 2.1 time: 0.088442 Oct 14 03:11:12.162463 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 267/555] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:12 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1460 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:12.267227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:12.269505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:12.276045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.276528 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.276965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.277650 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.278130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.278554 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.308464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9fa6ead2-8dee-4a87-bd10-23c55f1f3fe2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Oct 14 03:11:12.309020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 289/556] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:11:12 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:12.400282 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:12.400802 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:12.408826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.409443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.409910 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.411348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:12.412163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:12.412589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:12.548420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:12.557093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:12.558608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:12.559749 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-886f8931-9717-4ca9-b1c0-040f1a618734 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1797 microversion: 2.20 time: 0.163503 Oct 14 03:11:12.560315 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 268/557] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:11:12 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1797 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:11:13.189292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:13.189292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:13.193198 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.198015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.198015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.198015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.198015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.198368 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.198457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:13.227556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.228043 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.228479 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.228919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lazy-loading 'fault' on Instance uuid be136ee8-8ea0-493c-bbf7-62afa57e13e1 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:13.272738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b2d8f2742d4e5a8576e16c122c95ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8543c66ed4a6889a7740932dc6433', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:13.281537 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-67c55af1-346f-483e-80eb-037cf6e1c7d0 tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 200 len: 1303 microversion: 2.1 time: 0.100039 Oct 14 03:11:13.282126 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 290/558] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:13 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:13.320644 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:13.322798 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:13.328659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.329144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.329577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.330289 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.330742 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.331164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.359813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5e389c26-7890-4fa6-a461-42794feb6879 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042545 Oct 14 03:11:13.360365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 269/559] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:11:13 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:11:13.423492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:13.423928 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:13.430413 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.430888 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.431315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.431987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.432433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.432892 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.459196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:11:13.721711 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-738b457c-8693-4ab6-a47c-6478b8ca3748 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 204 len: 0 microversion: 2.1 time: 0.302227 Oct 14 03:11:13.722261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 291/560] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:11:13 2022] DELETE /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:11:13.730463 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:13.731077 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:13.738302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.738782 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.739214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.739903 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:13.740355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:13.740810 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:13.871443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:13.879052 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-aa4f9516-1f1a-45d5-a77f-8256000b90d4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.152343 Oct 14 03:11:13.879604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 270/561] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:13 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:14.305024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:14.305636 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] [instance: be136ee8-8ea0-493c-bbf7-62afa57e13e1] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:14.312081 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.312558 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.312994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:14.313677 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.314160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.314584 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:14.328412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] HTTP exception thrown: Instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 could not be found. Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Request method failure captured: Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 HTTP/1.1 Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNMAj3FFcooDACgdfDS-q-SW3WYH0rfFShITk5sbQPlG7dTS0FkPWE8knY-dI-6QhtymyhURHTAQqBK8xze-TzBvdkTVGOQXLzrHosQnjMCbKl1i0clW0QPbFcNxmrOW2PAOUlRnUVkFGXi3q6fs_ofJIwEKMWOcEPK67hLCDarscyQ Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 57c8543c66ed4a6889a7740932dc6433 Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-VolumesActionsTest-2146584022 Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:11:14.330923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/57c8543c66ed4a6889a7740932dc6433"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/57c8543c66ed4a6889a7740932dc6433"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/57c8543c66ed4a6889a7740932dc6433"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_57c8543c66ed4a6889a7740932dc6433"}]}] Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-VolumesActionsTest-2146584022 Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 57c8543c66ed4a6889a7740932dc6433 Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-VolumesActionsTest-2146584022 Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-VolumesActionsTest-2146584022-project Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: e9b2d8f2742d4e5a8576e16c122c95ac Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-VolumesActionsTest-2146584022-project Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 could not be found. Oct 14 03:11:14.332542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'be136ee8-8ea0-493c-bbf7-62afa57e13e1'} Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 could not be found. Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:11:14.333380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 could not be found. Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 could not be found. Oct 14 03:11:14.334836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:11:14.335992 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] Returning 404 to user: Instance be136ee8-8ea0-493c-bbf7-62afa57e13e1 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:11:14.335992 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ea933994-4151-421e-9170-f4a794a19ebd tempest-VolumesActionsTest-2146584022 tempest-VolumesActionsTest-2146584022-project] 10.222.0.39 "GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1" status: 404 len: 111 microversion: 2.1 time: 0.031551 Oct 14 03:11:14.335992 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 292/562] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:14 2022] GET /compute/v2.1/servers/be136ee8-8ea0-493c-bbf7-62afa57e13e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:11:14.902809 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:14.903496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:14.910286 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.910769 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.911194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:14.911899 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:14.912330 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:14.912764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:15.043094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:15.051369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-77ca6869-b200-4ba2-a1f9-f323c6510070 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.152476 Oct 14 03:11:15.052033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 271/563] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:14 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:16.074909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:16.075523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:16.082711 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:16.083189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:16.083625 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:16.084341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:16.084797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:16.085222 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:16.215541 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:16.223202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2be80720-4e08-4b01-ba19-00a06395f534 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.152195 Oct 14 03:11:16.223758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 293/564] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:16 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:17.246610 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:17.247213 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:17.253718 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:17.254224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:17.254650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:17.255330 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:17.255787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:17.256188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:17.387368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:17.395810 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-114819b0-7bc5-49a4-b674-0d6a55b33899 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.152970 Oct 14 03:11:17.396378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 272/565] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:17 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:18.418631 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:18.419244 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:18.426428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:18.426911 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:18.427375 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:18.428060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:18.428514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:18.428930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:18.552576 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:18.560186 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9fb7cea6-4071-4657-9123-772a49910cb3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.145433 Oct 14 03:11:18.560745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 294/566] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:18 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:19.583282 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:19.583892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:19.590402 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:19.590883 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:19.591314 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:19.591999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:19.592458 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:19.592880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:19.722897 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:19.730476 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-894bb311-698f-4a09-835f-1c0eabd4d2eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.151052 Oct 14 03:11:19.731030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 273/567] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:19 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:20.753344 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:20.753978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:20.760329 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:20.760804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:20.761236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:20.761966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:20.762411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:20.762828 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:20.888135 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:20.896440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1fa06be9-ad75-4930-bda6-0c56b6031a1e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.146968 Oct 14 03:11:20.896997 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 295/568] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:20 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:21.919519 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:21.919979 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:21.927011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:21.927495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:21.927932 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:21.928622 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:21.929076 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:21.929512 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:22.056201 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:22.063751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a5419b6c-b8cf-4a9c-8f39-4010c30a87a5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.148179 Oct 14 03:11:22.064306 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 274/569] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:21 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:23.086574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:23.087312 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:23.093726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:23.094239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:23.094670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:23.095355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:23.095810 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:23.096231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:23.231080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:23.240281 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-36f662ac-a32b-4f49-a660-16d2906dbcfc tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1680 microversion: 2.1 time: 0.157568 Oct 14 03:11:23.240852 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 296/570] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:23 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:23.278733 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:23.279383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:23.281829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=65 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:23.286614 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:23.287319 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:23.287799 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:23.288499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:23.289178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:23.289843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:23.415945 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lazy-loading 'services' on Instance uuid 258e7a24-1f44-4662-b9b0-4f35c319a2d2 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:23.688473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e6c6627a-0844-4834-93f1-2fcb0202aef5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/os-volume_attachments/fb5e9647-d521-4713-9039-56e3084b9eb9" status: 202 len: 0 microversion: 2.1 time: 0.413391 Oct 14 03:11:23.689142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 275/571] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:11:23 2022] DELETE /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/os-volume_attachments/fb5e9647-d521-4713-9039-56e3084b9eb9 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:11:24.052165 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-cfddadad-a668-48d4-9800-a8d23bcd3057 req-8ff90162-2eea-48da-bb89-94cd47734d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73287e1d-7bf7-4ebb-93e4-7e16bd29655e", "name": "network-vif-deleted", "tag": "19709406-415e-437a-9a30-3eb561347116"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:24.061602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-cfddadad-a668-48d4-9800-a8d23bcd3057 req-8ff90162-2eea-48da-bb89-94cd47734d58 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:24.062386 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-cfddadad-a668-48d4-9800-a8d23bcd3057 req-8ff90162-2eea-48da-bb89-94cd47734d58 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:24.062879 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-cfddadad-a668-48d4-9800-a8d23bcd3057 req-8ff90162-2eea-48da-bb89-94cd47734d58 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:24.073800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-cfddadad-a668-48d4-9800-a8d23bcd3057 req-8ff90162-2eea-48da-bb89-94cd47734d58 service nova] Creating event network-vif-deleted:19709406-415e-437a-9a30-3eb561347116 for instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e on hv-cinder-80152 Oct 14 03:11:24.079209 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-cfddadad-a668-48d4-9800-a8d23bcd3057 req-8ff90162-2eea-48da-bb89-94cd47734d58 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Oct 14 03:11:24.079797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 297/572] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:24.266236 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:24.268030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:24.273220 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:24.274007 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:24.274447 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:24.275155 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:24.275611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:24.276186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:24.300722 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:24.352552 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:24.357904 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ddb14fc9-f484-4695-a2e3-6bb000a1f589 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1326 microversion: 2.1 time: 0.097698 Oct 14 03:11:24.358548 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 276/573] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:24 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:25.386953 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:25.387958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:25.396086 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.396648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.411369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:25.411369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.411369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.411369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:25.444658 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:25.445423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:25.446066 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:25.446548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid 73287e1d-7bf7-4ebb-93e4-7e16bd29655e {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:25.512970 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:25.526100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3ccf6910-b25a-403e-93f7-0df86561e58d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 200 len: 1331 microversion: 2.1 time: 0.144559 Oct 14 03:11:25.527460 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 298/574] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:25 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 1331 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:26.551432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:26.552205 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:26.566161 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:26.567123 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:26.570753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:26.570753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:26.570753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:26.570753 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:26.589420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e HTTP/1.1 Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:11:26.591711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:11:26.593337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '73287e1d-7bf7-4ebb-93e4-7e16bd29655e'} Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:11:26.594384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:11:26.595927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:26.597898 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:11:26.598906 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-23156da7-f68a-4e70-a116-83faf4cf1ef1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 404 len: 111 microversion: 2.1 time: 0.052281 Oct 14 03:11:26.605909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 277/575] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:26 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:11:26.608361 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c944cc0b-7b64-4238-9998-79b36f867547 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '.version_select at 0x7f2beb8d9f70>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:26.677726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c944cc0b-7b64-4238-9998-79b36f867547 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065246945" status: 202 len: 0 microversion: 2.1 time: 0.073521 Oct 14 03:11:26.678493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 299/576] 10.222.0.39 () {58 vars in 1221 bytes} [Fri Oct 14 03:11:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065246945 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:11:27.628295 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5eba216d-4a34-495c-b866-889e56bd9464 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: .version_select at 0x7f2beb966ee0>, body: {"keypair": {"name": "tempest-keypair-2117831336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGV65aZAOoa1DpLetRRcDPkSni3hEdFAz3wdUMQs0sG/WJ25eb4HEpjjoASaU+GmO7MqRwfaibH5tgO+8NdJHVtuZTO66AEIvWJFzEeffjtolxSwVRpIZ1u5Sw4cbjj8dQ=="}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:27.637256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:27.637888 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:27.645585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:27.646210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:27.646747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:27.647448 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:27.647918 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:27.648334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:27.653960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-5eba216d-4a34-495c-b866-889e56bd9464 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for project 20fb24be77624e59b8560c7863ca4a46. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:11:27.660456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-5eba216d-4a34-495c-b866-889e56bd9464 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for user 410b7c9e93c94ce78d1b5c0e646307a2 and project 20fb24be77624e59b8560c7863ca4a46. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:11:27.733113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lazy-loading 'services' on Instance uuid b19d9d10-c7d3-4d5f-b180-0663a2283d54 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:27.967397 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5eba216d-4a34-495c-b866-889e56bd9464 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.345891 Oct 14 03:11:27.968048 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 278/577] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:11:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:28.110946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8085ba50-1530-4fdb-812e-52a3173d1460 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54/os-volume_attachments/f823fd16-7e9d-471a-9efc-45a24c7cd56b" status: 202 len: 0 microversion: 2.1 time: 0.479186 Oct 14 03:11:28.112266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 300/578] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:11:27 2022] DELETE /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54/os-volume_attachments/f823fd16-7e9d-471a-9efc-45a24c7cd56b => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:11:30.380782 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:30.383310 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:30.409088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.420010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.420865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:30.421899 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.422625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.423168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:30.448161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1140551331", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb28930e-3d0a-43c7-985a-b1d6573d124d"}], "security_groups": [{"name": "tempest-securitygroup--523601925"}], "key_name": "tempest-keypair-2117831336", "user_data": "}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:30.458057 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lazy-loading 'flavor' on Instance uuid 07426fa3-a9d9-4304-854a-b6a298b3f8c7 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:30.570403 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] validate_networks() for [('bb28930e-3d0a-43c7-985a-b1d6573d124d', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:11:30.834827 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-91e22396-f48a-4db8-a6e0-e06479c738b7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/action" status: 200 len: 32 microversion: 2.1 time: 0.460332 Oct 14 03:11:30.835718 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 279/579] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:11:30 2022] POST /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/action => generated 32 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:11:30.849493 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:30.850533 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:30.864790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.866222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.868738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:30.870414 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:30.871438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:30.872803 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.114552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:11:31.115109 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:11:31.115693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:11:31.116213 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:11:31.116731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:11:31.133833 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.135176 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.144699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.144699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.144699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.144699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.145237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:31.152305 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6aa6e5bc-789b-4e46-a636-e9fa4973f0b6 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.309983 Oct 14 03:11:31.152825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 280/580] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:30 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:31.167321 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for project 20fb24be77624e59b8560c7863ca4a46. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:11:31.173395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for user 410b7c9e93c94ce78d1b5c0e646307a2 and project 20fb24be77624e59b8560c7863ca4a46. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:11:31.190570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:11:31.194278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:11:31.436231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-63e9e815-6796-4501-a7c1-324cbff5dbfe tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.000499 Oct 14 03:11:31.446942 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 301/581] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:11:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:11:31.451934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-deaa4d43-537f-459b-b73f-d5c8d0d1759f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:31.453470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-deaa4d43-537f-459b-b73f-d5c8d0d1759f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:31.567607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5d02951e-dc23-40b7-960e-b2cf89d12960 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:31.578187 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d02951e-dc23-40b7-960e-b2cf89d12960 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.578675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d02951e-dc23-40b7-960e-b2cf89d12960 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.583136 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5d02951e-dc23-40b7-960e-b2cf89d12960 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.607002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-deaa4d43-537f-459b-b73f-d5c8d0d1759f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:31.618380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-deaa4d43-537f-459b-b73f-d5c8d0d1759f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1242 microversion: 2.1 time: 0.173461 Oct 14 03:11:31.623215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 281/582] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:31 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1242 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:31.644649 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5d02951e-dc23-40b7-960e-b2cf89d12960 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Going to try to stop instance {{(pid=119284) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 14 03:11:31.874580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5d02951e-dc23-40b7-960e-b2cf89d12960 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/action" status: 202 len: 0 microversion: 2.1 time: 0.310592 Oct 14 03:11:31.875936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 302/583] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:11:31 2022] POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:11:31.895731 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:31.896416 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:31.917823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.918338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.918951 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:31.920163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:31.920765 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:31.921949 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.085076 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:32.096444 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3ca48885-9f3b-4c33-9031-3af1939c5225 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.214964 Oct 14 03:11:32.096577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 282/584] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:31 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:32.178804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:32.179849 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:32.188033 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.188773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.189339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.190180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.190870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.191504 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.399949 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:32.413688 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-783a708f-11d6-41a2-aac7-8010ab0e7b87 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.239180 Oct 14 03:11:32.426332 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 303/585] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:32 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:32.556957 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:32.558079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:32.565053 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.571410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.571410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.571410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.571410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.571754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.599654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:11:32.644256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:32.644874 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:32.653083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.657588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.657588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.657588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.657588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.657990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.730879 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:32.740039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0cb36b05-56ed-437c-9b35-2f2a44fe06b5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1246 microversion: 2.1 time: 0.100285 Oct 14 03:11:32.740617 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 304/586] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:32 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:32.974473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b6b0503d-20c1-4b37-8b97-97b40e12206e tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 204 len: 0 microversion: 2.1 time: 0.420925 Oct 14 03:11:32.975760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 283/587] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:11:32 2022] DELETE /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:11:32.984475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:32.985007 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:32.991459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.993893 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.994748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:32.995875 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:32.996772 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:32.997402 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.121594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:33.122325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:33.129560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:33.130298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:33.130732 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.131434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:33.131886 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:33.132333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.156756 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:33.163668 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:33.167290 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3c7a1518-9fb1-4ba8-b4c2-9170dccf1bdf tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1514 microversion: 2.1 time: 0.187457 Oct 14 03:11:33.167861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 305/588] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:32 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:33.294903 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:33.303714 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-09d31e7c-26b1-4ab3-8ea0-a4973d1dcfc9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.186712 Oct 14 03:11:33.304848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 284/589] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:33 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:33.437186 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:33.438181 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:33.444745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:33.445233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:33.445665 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.448067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:33.448067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:33.448067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.600991 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:33.611131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9c98a7fc-af1d-4fcc-badd-5115be49b2b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.178178 Oct 14 03:11:33.611915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 306/590] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:33 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:33.762703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:33.763311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:33.770097 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:33.770790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:33.771218 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.771904 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:33.772407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:33.772826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:33.842430 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:33.850981 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2237f4eb-68f2-445d-9a34-78cb36bc9e80 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1238 microversion: 2.1 time: 0.092268 Oct 14 03:11:33.851645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 285/591] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:33 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:34.193814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:34.194922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:34.203428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.204146 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.204648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.205704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.206190 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.206623 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.330234 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:34.331511 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:34.341048 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.341635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.342342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.343373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.344175 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.344693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.353395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:34.362067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5cb5106b-9295-48cf-b5eb-b9741a4fb46b tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1514 microversion: 2.1 time: 0.172357 Oct 14 03:11:34.374664 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 307/592] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:34 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:34.509209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:34.517667 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ffb8312f-58fb-4949-8ff0-b3641162ab50 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.193818 Oct 14 03:11:34.518282 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 286/593] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:34 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:34.635743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:34.636274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:34.642391 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.642878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.643309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.644006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.644453 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.644873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.790441 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:34.799439 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0fc9b241-9da8-4d01-91b0-5c7b04ce01dd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.167616 Oct 14 03:11:34.806890 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 308/594] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:34 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:34.877811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:34.878492 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:34.885138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.885619 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.886132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.886764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:34.887207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:34.887622 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:34.951690 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:34.961149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5d7d29fb-4e86-4b8c-9c7b-a69d150d1881 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1238 microversion: 2.1 time: 0.087221 Oct 14 03:11:34.977076 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 287/595] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:34 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:35.385156 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:35.386305 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:35.394233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:35.394725 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:35.395365 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:35.396078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:35.396534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:35.396957 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:35.540972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:35.541621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:35.549927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:35.551705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:35.552378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:35.553334 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:35.553973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:35.554580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:35.683595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:35.691902 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-993c7301-37ed-4e02-b41a-b91bb319a50f tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1514 microversion: 2.1 time: 0.311051 Oct 14 03:11:35.711598 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 309/596] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:35 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1514 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:35.746106 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:35.754420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2f25dfb8-708b-4929-8f4c-e3e9ec539cf7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.217617 Oct 14 03:11:35.766175 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 288/597] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:35 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:35.832906 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:35.833626 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:35.838923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:35.841049 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:35.841809 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:35.842479 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:35.843991 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:35.844452 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:35.845033 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:35.985983 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:35.987333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:36.011783 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:36.022251 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:36.022591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9d989d64-6764-406b-b5f4-772c9d18d30d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.193425 Oct 14 03:11:36.023162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 310/598] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:35 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:36.024174 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:36.024833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:36.026032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:36.026946 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:36.027789 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:36.114597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:36.125919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0bbdf843-7a18-4fdc-bde2-4f2456be7584 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1294 microversion: 2.1 time: 0.142735 Oct 14 03:11:36.148299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 289/599] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:35 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1294 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:36.463324 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-fecc69fd-488f-4531-a716-6e242634058b req-93fa4182-5d40-4e33-ab94-e810c76fe075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19d9d10-c7d3-4d5f-b180-0663a2283d54", "name": "network-vif-deleted", "tag": "618fd49c-b150-468d-b8f2-201e9a4b4aa8"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:36.480311 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-fecc69fd-488f-4531-a716-6e242634058b req-93fa4182-5d40-4e33-ab94-e810c76fe075 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:36.481285 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-fecc69fd-488f-4531-a716-6e242634058b req-93fa4182-5d40-4e33-ab94-e810c76fe075 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:36.482828 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-fecc69fd-488f-4531-a716-6e242634058b req-93fa4182-5d40-4e33-ab94-e810c76fe075 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:36.501347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-fecc69fd-488f-4531-a716-6e242634058b req-93fa4182-5d40-4e33-ab94-e810c76fe075 service nova] Creating event network-vif-deleted:618fd49c-b150-468d-b8f2-201e9a4b4aa8 for instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 on hv-cinder-80152 Oct 14 03:11:36.510919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-fecc69fd-488f-4531-a716-6e242634058b req-93fa4182-5d40-4e33-ab94-e810c76fe075 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052330 Oct 14 03:11:36.517489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 311/600] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:36.716968 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:36.717830 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:36.724211 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:36.725024 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:36.725559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:36.726369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:36.727216 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:36.727903 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:36.780154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:36.781154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:36.792805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:36.793450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:36.794023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:36.795020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:36.796210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:36.806319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:36.830557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:36.840863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ac1da88c-78ea-475d-896a-680a178a0d77 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1472 microversion: 2.1 time: 0.127341 Oct 14 03:11:36.841928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 290/601] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:36 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1472 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:36.990374 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:36.999497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9da6b137-2836-4d58-91eb-06a22c8863e9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.223437 Oct 14 03:11:37.000395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 312/602] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:36 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:37.047225 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:37.047843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:37.054450 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.054926 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.055419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.056357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.056972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.057597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.158764 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:37.159360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:37.171957 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.172459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.172904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.174827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.175495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.175931 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.293797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:37.303422 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:37.308922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-393ff97f-5ef4-4ddf-8e83-0f9421d2d7eb tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1300 microversion: 2.1 time: 0.156303 Oct 14 03:11:37.310140 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 313/603] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:37 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:37.312393 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-343bec67-7514-4663-9353-a8aa93e63570 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.270025 Oct 14 03:11:37.325780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 291/604] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:37 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:37.872266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:37.873554 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:37.882101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.882967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.883591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.884681 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.885376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.886009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.949329 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:37.950161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:37.951278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:37.952553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lazy-loading 'fault' on Instance uuid b19d9d10-c7d3-4d5f-b180-0663a2283d54 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:38.006343 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:38.024324 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:38.025139 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:38.028114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c02b496c-782b-4224-98ff-add69701284a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1309 microversion: 2.1 time: 0.160247 Oct 14 03:11:38.029064 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 314/605] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:37 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:38.058361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:38.063618 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:38.064760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:38.065656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:38.066246 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:38.066771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:38.072328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:38.249673 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:38.260182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-906e8f00-89b5-4c08-89e2-ced007f3f13b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.240441 Oct 14 03:11:38.265808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 292/606] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:38 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:38.333173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:38.337478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:38.338372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:38.338996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:38.340178 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:38.340668 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:38.341105 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:38.341826 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:38.342308 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:38.343266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:38.345947 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:38.346604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:38.347033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:38.347718 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:38.348186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:38.348637 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:38.611123 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:38.629017 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bacf547b-15ec-48e3-b99a-a62ab28d22a2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.295102 Oct 14 03:11:38.629017 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 293/607] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:38 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:38.629232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:38.650139 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a0aa22f0-d373-483d-8227-0a1bf1e5ab92 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.320096 Oct 14 03:11:38.653749 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 315/608] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:38 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:39.041474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-6749536d-62b2-48f0-aaae-0d20a31d8dbe req-2aa1a4b3-e476-4214-8cc3-995dfd515f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd7272a-6200-4e43-a875-486a9dfdf4de", "tag": "fca8f750-40b5-480b-be0b-74873e93a6ba"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:39.052363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:39.053345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:39.054361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6749536d-62b2-48f0-aaae-0d20a31d8dbe req-2aa1a4b3-e476-4214-8cc3-995dfd515f61 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.054843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6749536d-62b2-48f0-aaae-0d20a31d8dbe req-2aa1a4b3-e476-4214-8cc3-995dfd515f61 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.057790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6749536d-62b2-48f0-aaae-0d20a31d8dbe req-2aa1a4b3-e476-4214-8cc3-995dfd515f61 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.060871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.061982 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.063292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.064229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.065394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.066025 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.068844 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-6749536d-62b2-48f0-aaae-0d20a31d8dbe req-2aa1a4b3-e476-4214-8cc3-995dfd515f61 service nova] Creating event network-changed:fca8f750-40b5-480b-be0b-74873e93a6ba for instance ccd7272a-6200-4e43-a875-486a9dfdf4de on hv-cinder-80152 Oct 14 03:11:39.074549 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-6749536d-62b2-48f0-aaae-0d20a31d8dbe req-2aa1a4b3-e476-4214-8cc3-995dfd515f61 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037920 Oct 14 03:11:39.075700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 294/609] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:39.117290 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.118508 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.119634 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.120490 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lazy-loading 'fault' on Instance uuid b19d9d10-c7d3-4d5f-b180-0663a2283d54 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:11:39.206702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced832cf86304814b020de4ed3e0955f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3dfb4977504552a5480cd375ded7dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:39.219987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d03c1eb0-cf28-4cf9-bf71-69940c175a12 tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 200 len: 1309 microversion: 2.1 time: 0.171695 Oct 14 03:11:39.221181 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 316/610] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:39 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:39.288250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:39.289989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:39.304547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.305039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.305477 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.306267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.306721 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.307142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.477114 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:39.488800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0b319702-223f-4e6d-a9d1-577d8a4c3016 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.203870 Oct 14 03:11:39.489635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 295/611] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:39 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:39.653182 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:39.654048 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:39.663896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.665564 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.666633 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.667685 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.668446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.669305 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.677557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:39.678321 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:39.686068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.704465 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.704465 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.704465 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:39.704465 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:39.704909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:39.907279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:39.919455 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b4a74132-cfb0-4e6a-815e-2d7af1b1d4c9 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.245577 Oct 14 03:11:39.939725 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 296/612] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:39 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:39.963412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:39.977847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b8b3c6f2-ba72-4d72-994a-9b57d02a10c5 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.329025 Oct 14 03:11:39.979753 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 317/613] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:39 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:40.243768 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:40.244545 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] [instance: b19d9d10-c7d3-4d5f-b180-0663a2283d54] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:40.251447 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:40.252048 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:40.252573 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:40.253361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:40.253943 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:40.254472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:40.273531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] HTTP exception thrown: Instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 could not be found. Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Request method failure captured: Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 HTTP/1.1 Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNK4c1ZNMmMaggROfqVnUtypQLXHrSSqX2kbw2pm4AHBdk01-lvwF1Mg34qrANjWTAK-yWcd3nOdxDWwSRCdeIsGRHs_VjhI-d_jfQcTIphliG_tWXEhlTwD5TfOhEaO2x0iiWkoYJqYuXm0ubwlFxYoqh7QNYf94W6TrFLN6xVyfrs Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 9e3dfb4977504552a5480cd375ded7dd Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1275051050 Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:11:40.279342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e3dfb4977504552a5480cd375ded7dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e3dfb4977504552a5480cd375ded7dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e3dfb4977504552a5480cd375ded7dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e3dfb4977504552a5480cd375ded7dd"}]}] Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-VolumesSnapshotTestJSON-1275051050 Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 9e3dfb4977504552a5480cd375ded7dd Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1275051050 Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-VolumesSnapshotTestJSON-1275051050-project Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: ced832cf86304814b020de4ed3e0955f Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-VolumesSnapshotTestJSON-1275051050-project Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 could not be found. Oct 14 03:11:40.282103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'b19d9d10-c7d3-4d5f-b180-0663a2283d54'} Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 could not be found. Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:11:40.283230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 could not be found. Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 could not be found. Oct 14 03:11:40.284858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:11:40.287715 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] Returning 404 to user: Instance b19d9d10-c7d3-4d5f-b180-0663a2283d54 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:11:40.287715 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-60750dd5-d4ed-41f3-ab32-c91efaee6c9a tempest-VolumesSnapshotTestJSON-1275051050 tempest-VolumesSnapshotTestJSON-1275051050-project] 10.222.0.39 "GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54" status: 404 len: 111 microversion: 2.1 time: 0.041361 Oct 14 03:11:40.287715 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 297/614] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:40 2022] GET /compute/v2.1/servers/b19d9d10-c7d3-4d5f-b180-0663a2283d54 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:11:40.516822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:40.517612 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:40.524895 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:40.525456 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:40.526014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:40.526804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:40.527317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:40.527801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:40.683009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:40.693680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9c770d61-dc20-467b-b5bd-a4cfc96d51f6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.181146 Oct 14 03:11:40.694620 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 318/615] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:40 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:40.947781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:40.948400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:40.955300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:40.956019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:40.956604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:40.961156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:40.961156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:40.961156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:41.019137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:41.019764 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:41.030796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:41.031300 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:41.042128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:41.042923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:41.043416 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:41.043851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:41.152772 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:41.183295 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=6 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:41.222890 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:41.231563 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c57c6de4-67eb-4388-831b-bdd2d7e66b22 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.287913 Oct 14 03:11:41.246437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 298/616] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:40 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:41.279278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:41.288057 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-425f3afd-db51-4bce-845a-90ad613bb3c7 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.285738 Oct 14 03:11:41.288923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 319/617] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:41 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:41.717328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:41.718868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:41.721578 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:41.727132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:41.727623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:41.728062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:41.728774 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:41.729229 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:41.729656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:41.859346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:41.866928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2c424717-a9d6-4358-8649-3c149c3cbfe1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.153713 Oct 14 03:11:41.868083 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 299/618] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:41 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:42.256470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:42.258105 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:42.265525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:42.266419 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:42.267076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:42.268401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:42.269113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:42.269658 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:42.320605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:42.321248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:42.328391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:42.328896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:42.329327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:42.330233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:42.330692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:42.331117 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:42.507573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:42.519355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-898cce89-0567-4b1a-bcdb-bd92d47e94ef tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.267017 Oct 14 03:11:42.520299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 320/619] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:42 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:42.538526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:42.549538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a5708944-1f7f-4dea-b85e-6b03a777fc06 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.241900 Oct 14 03:11:42.550483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 300/620] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:42 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:42.890543 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:42.891161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:42.897120 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:42.897640 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:42.898107 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:42.898799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:42.899252 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:42.899671 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:43.029611 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:43.037812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e522cfdf-e236-4d99-bd54-2649619668dc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.151174 Oct 14 03:11:43.038306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 321/621] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:42 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:43.542631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:43.543238 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:43.549838 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:43.550319 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:43.550757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:43.551448 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:43.551899 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:43.552318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:43.573788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:43.574451 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:43.581096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:43.581576 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:43.582049 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:43.582733 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:43.583183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:43.583602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:43.599339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:43.727870 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:43.735711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c56cb003-22bd-4cbe-be54-7f0eb7c5ce36 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.196977 Oct 14 03:11:43.736274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 301/622] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:43 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:43.757475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:43.766249 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a8ef243d-73ed-4dd1-b5b7-afd38d158de1 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.196196 Oct 14 03:11:43.766813 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 322/623] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:43 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:44.062127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:44.062737 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:44.068668 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.069150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.069583 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.070286 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.070737 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.071159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.195453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:44.203101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c0e7451e-b15e-4ce1-92f6-ddd779064bd4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.145384 Oct 14 03:11:44.203660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 302/624] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:44 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:44.759315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:44.759903 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:44.767010 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.767491 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.767921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.768606 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.769062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.769483 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.788412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:44.789438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:44.796327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.796877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.797307 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.798042 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:44.798493 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:44.798935 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:44.958274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:44.966461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1cc5f5fc-c4d7-498b-8ac7-5113760fcb88 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.211049 Oct 14 03:11:44.967251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 323/625] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:44 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:44.981171 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:44.989717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8722d872-214a-499a-bf85-ed68e295f2bf tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.205201 Oct 14 03:11:44.990318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 303/626] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:44 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:45.226369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:45.226976 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:45.232803 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:45.233275 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:45.233699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:45.234661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:45.235107 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:45.235525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:45.361910 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:45.369435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c18d35b6-cc11-4e4b-9e65-eb3e53b4542e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.146865 Oct 14 03:11:45.370018 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 324/627] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:45 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:45.994640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:45.995185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:46.001535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:46.002047 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:46.002473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:46.003157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:46.003601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:46.004018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:46.013569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:46.014167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:46.020540 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:46.021020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:46.021465 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:46.022180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:46.022627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:46.023043 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:46.199507 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:46.205184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:46.208111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d4be00ab-e29d-4574-85c5-a1d2f1186b14 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.217234 Oct 14 03:11:46.208761 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 304/628] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:45 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:46.216143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1f250134-8f24-4c6e-8352-c3c5086df991 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.206290 Oct 14 03:11:46.219232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 325/629] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:46 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:46.393329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:46.394158 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:46.399959 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:46.400426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:46.400865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:46.401559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:46.402036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:46.402461 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:46.527775 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:46.539237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4ef5678e-ff9c-4948-97ea-a03a49ee0676 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1677 microversion: 2.1 time: 0.150127 Oct 14 03:11:46.539887 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 305/630] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:46 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:47.232538 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.233741 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.240675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.241168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.241601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.242480 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.242902 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.243154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.243257 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.243483 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.250583 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.251069 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.253348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.253348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.253348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.253348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.447863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:47.453073 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:47.461141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-95a95e7d-20f6-475a-8e44-2a6df41feeff tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.222499 Oct 14 03:11:47.461718 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 306/631] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:47 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:47.464885 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a44d7c40-aeaa-4647-95f6-90179caa575b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.236189 Oct 14 03:11:47.465569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 326/632] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:47 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:47.562535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.563152 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.569119 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.569611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.570085 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.570779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.571232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.571649 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.702188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:47.710133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e3666e22-8022-4fdc-a01b-15831dd87259 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1654 microversion: 2.1 time: 0.151598 Oct 14 03:11:47.710702 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 307/633] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:47 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:47.732746 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f8d7835c-834f-4711-9862-548b300cc4e4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:47.738913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8d7835c-834f-4711-9862-548b300cc4e4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.739401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8d7835c-834f-4711-9862-548b300cc4e4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.739838 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8d7835c-834f-4711-9862-548b300cc4e4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.761050 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f8d7835c-834f-4711-9862-548b300cc4e4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Going to try to start instance {{(pid=119284) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 14 03:11:47.971924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f8d7835c-834f-4711-9862-548b300cc4e4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/action" status: 202 len: 0 microversion: 2.1 time: 0.242633 Oct 14 03:11:47.972455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 327/634] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:11:47 2022] POST /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:11:47.980850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:47.981846 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:47.988023 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.988514 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.988951 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:47.989677 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:47.990119 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:47.990537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.032761 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-1bf68845-f962-4ed3-8d8f-f1764a79bb77 req-f1bf6a33-e087-4e7a-8057-403e188024b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd7272a-6200-4e43-a875-486a9dfdf4de", "name": "network-vif-plugged", "status": "completed", "tag": "fca8f750-40b5-480b-be0b-74873e93a6ba"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:48.047842 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1bf68845-f962-4ed3-8d8f-f1764a79bb77 req-f1bf6a33-e087-4e7a-8057-403e188024b9 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.048392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1bf68845-f962-4ed3-8d8f-f1764a79bb77 req-f1bf6a33-e087-4e7a-8057-403e188024b9 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.048882 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1bf68845-f962-4ed3-8d8f-f1764a79bb77 req-f1bf6a33-e087-4e7a-8057-403e188024b9 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.068417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-1bf68845-f962-4ed3-8d8f-f1764a79bb77 req-f1bf6a33-e087-4e7a-8057-403e188024b9 service nova] Creating event network-vif-plugged:fca8f750-40b5-480b-be0b-74873e93a6ba for instance ccd7272a-6200-4e43-a875-486a9dfdf4de on hv-cinder-80152 Oct 14 03:11:48.068417 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-1bf68845-f962-4ed3-8d8f-f1764a79bb77 req-f1bf6a33-e087-4e7a-8057-403e188024b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041124 Oct 14 03:11:48.068977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 328/635] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:48.130265 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:48.139159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-14149c75-0049-475c-821e-a848fc492ce5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1663 microversion: 2.1 time: 0.162328 Oct 14 03:11:48.140506 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 308/636] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:47 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:48.490020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:48.490020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:48.490654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:48.490654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:48.494036 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.494604 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.495108 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.496144 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.496389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.496828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.497163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.497303 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.497788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.497997 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:48.498447 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:48.499506 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:48.710466 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:48.717419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:48.718732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9744dcac-6565-4abf-9413-f1ddcd0e4f3c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.237856 Oct 14 03:11:48.722761 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 329/637] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:48 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:48.725269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9b79483e-c3f5-4d34-960d-4cdb9fcbd6fa tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.240897 Oct 14 03:11:48.725848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 309/638] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:48 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:49.164156 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:49.164811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:49.171463 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.171951 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.172390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.173089 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.173549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.174005 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.306142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:49.314238 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0e6bbf9c-5a5f-4259-a0ea-1d4e2f9d51fb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1663 microversion: 2.1 time: 0.153889 Oct 14 03:11:49.314814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 330/639] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:49 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:49.747110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:49.750826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:49.750965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:49.750965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:49.760001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.760107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.760724 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.761436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.762010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.762700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.762989 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.763480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.764011 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.765330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:49.765805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:49.766236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:49.769611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:49.969784 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:49.973512 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:49.978424 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-65553c26-72b3-4864-93f2-5263223eb05d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.239789 Oct 14 03:11:49.979070 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 310/640] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:49 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:49.981665 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-89e40845-268a-431d-b9d6-e8a12cc2cfd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1367 microversion: 2.1 time: 0.237142 Oct 14 03:11:49.982366 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 331/641] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:49 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:50.339024 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:50.339802 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:50.346621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:50.347392 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:50.347993 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:50.348699 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:50.349146 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:50.349749 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:50.610539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:50.618284 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-703ff8fd-b560-4fa0-aea7-a332bbb802e7 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1663 microversion: 2.1 time: 0.283284 Oct 14 03:11:50.618853 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 311/642] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:50 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1663 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:51.004482 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:51.005482 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:51.016187 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.016331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:51.016767 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.016871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:51.016962 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.016962 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.016962 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.017458 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.021338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.021898 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.022514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.023376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.023827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.024424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.229580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:51.234405 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:51.242798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ffc7986e-f8f6-468e-b537-ff56932dff46 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.243973 Oct 14 03:11:51.243379 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 332/643] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:50 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:51.247856 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2d8a0dfe-08b8-472c-b8f9-bbfcfe63e402 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1557 microversion: 2.1 time: 0.247388 Oct 14 03:11:51.248951 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 312/644] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:50 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1557 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:51.277612 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:51.278160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:51.284410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.284890 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.285316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.286030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.286479 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.286896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.372537 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4899b6f8-0108-4de7-84e6-a074c02ada61 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098694 Oct 14 03:11:51.373127 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 333/645] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Oct 14 03:11:51 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:51.641691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:51.646496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:51.654636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.654636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.654636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.654636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:51.655262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:51.655351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:51.794088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:51.803379 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-07ddf780-cf07-47cd-8a96-54e02c68c1ae tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1667 microversion: 2.1 time: 0.165661 Oct 14 03:11:51.818747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 313/646] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:51 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1667 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:52.267564 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:52.268173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:52.274159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.274642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.275075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.275758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.276208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.276622 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.390469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-d9f7cdec-0136-47be-93e3-471cce1b096b req-026e99c7-b6a4-4cea-8563-58c8e0aa21d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd7272a-6200-4e43-a875-486a9dfdf4de", "tag": "fca8f750-40b5-480b-be0b-74873e93a6ba"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:52.412494 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-d9f7cdec-0136-47be-93e3-471cce1b096b req-026e99c7-b6a4-4cea-8563-58c8e0aa21d7 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:52.412985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-d9f7cdec-0136-47be-93e3-471cce1b096b req-026e99c7-b6a4-4cea-8563-58c8e0aa21d7 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:52.413178 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:52.413414 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-d9f7cdec-0136-47be-93e3-471cce1b096b req-026e99c7-b6a4-4cea-8563-58c8e0aa21d7 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:52.423030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d1d83f0b-a87c-4428-b77d-613dd46462f3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.160412 Oct 14 03:11:52.424024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 334/647] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:52 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:52.433391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-d9f7cdec-0136-47be-93e3-471cce1b096b req-026e99c7-b6a4-4cea-8563-58c8e0aa21d7 service nova] Creating event network-changed:fca8f750-40b5-480b-be0b-74873e93a6ba for instance ccd7272a-6200-4e43-a875-486a9dfdf4de on hv-cinder-80152 Oct 14 03:11:52.441475 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-d9f7cdec-0136-47be-93e3-471cce1b096b req-026e99c7-b6a4-4cea-8563-58c8e0aa21d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053673 Oct 14 03:11:52.442194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 314/648] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:11:53.448203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:53.448854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:53.455288 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:53.455766 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:53.456201 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:53.456889 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:53.457428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:53.457892 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:53.589678 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:53.598553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b1c04c84-9ddf-4546-a8c1-a3bd0b3fc7af tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.154136 Oct 14 03:11:53.599454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 335/649] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:53 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:54.624327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:54.625686 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:54.628285 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:54.633121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:54.633643 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:54.634099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:54.634787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:54.635231 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:54.635646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:54.775113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:54.785132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e1b92ae7-d432-4074-ad49-c8799d07db54 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.164938 Oct 14 03:11:54.789165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 315/650] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:54 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:55.810800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:55.811305 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:55.821559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:55.821559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:55.821559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:55.821559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:55.822597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:55.822597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:55.862038 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-185859439", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:11:55.919812 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] validate_networks() for None {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:11:56.067501 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:56.075968 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2bfd5cfb-7715-434c-932a-90531e770503 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.269526 Oct 14 03:11:56.076792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 336/651] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:55 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:56.218793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:11:56.219206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:11:56.219792 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:11:56.220197 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:11:56.220596 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:11:56.229324 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:56.229863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:56.230291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:56.231031 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:56.231479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:56.231893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:56.248688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Getting quotas for project bb2534240ab74afbae7843231469486a. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:11:56.253190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Getting quotas for user e7ee85ee112042f1abe5962d06d64ce0 and project bb2534240ab74afbae7843231469486a. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:11:56.264197 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:11:56.266594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:11:56.432658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c9660d2e-3987-4e5f-8666-876cb6b1aacf tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574603 Oct 14 03:11:56.433384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 316/652] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:11:56.444331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-37ab7fcf-d812-45a8-8252-74e7a4f72f40 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:56.444946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-37ab7fcf-d812-45a8-8252-74e7a4f72f40 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:56.512460 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-37ab7fcf-d812-45a8-8252-74e7a4f72f40 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:56.519428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-37ab7fcf-d812-45a8-8252-74e7a4f72f40 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1214 microversion: 2.1 time: 0.078799 Oct 14 03:11:56.524507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 337/653] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:56 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:57.101274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:57.102138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:57.108687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.110059 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.110496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.111182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.111628 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.112069 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.246279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:57.254534 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9fd3c1f9-0125-4857-832d-914050e8a074 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.157887 Oct 14 03:11:57.255099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 317/654] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:57 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:11:57.542291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:57.543053 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:57.548958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.549486 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.549979 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.550667 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:57.551114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:57.551582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:57.614547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:57.622805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-08a885ca-5b4b-43a2-9415-122c8e673f30 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1218 microversion: 2.1 time: 0.084186 Oct 14 03:11:57.623601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 338/655] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:57 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:58.277912 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:58.278548 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:58.285695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.286216 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.286652 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.287333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.287780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.288201 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.421091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:58.429407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-50ca5621-633d-475e-b2cc-1a1d5cc17dee tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.155512 Oct 14 03:11:58.430002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 318/656] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:58 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:58.646800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:58.647418 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:58.653829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.654281 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.654710 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.655390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:58.655837 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:58.656284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:58.720679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:58.728191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cad73be7-9845-4e7e-b16e-062611b9f575 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1266 microversion: 2.1 time: 0.085307 Oct 14 03:11:58.728751 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 339/657] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:58 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:59.452719 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:59.453732 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:59.461121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:59.461121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:59.463624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:59.463624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:59.469650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:59.470182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:59.601924 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:59.610759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4bde2ea3-c126-4a80-8eaf-2116d0b875f8 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.162066 Oct 14 03:11:59.611323 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 319/658] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:59 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:11:59.750797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:11:59.751409 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:11:59.757878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:59.759457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:59.759457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:59.759457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:11:59.760045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:11:59.760464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:11:59.763158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:59.824238 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:11:59.831812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-04914b78-4a08-45a8-a7fc-2631ef5d6b43 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1272 microversion: 2.1 time: 0.084881 Oct 14 03:11:59.832608 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 340/659] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:11:59 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:00.633838 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:00.634479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:00.641497 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.642006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.642436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.643125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.643598 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.644017 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.774360 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:00.783227 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cfb4a91e-1523-4889-930e-8ea6bddab9bc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.153233 Oct 14 03:12:00.783802 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 320/660] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:00 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:00.854887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:00.855496 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:00.863097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.863578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.864008 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.864694 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:00.865223 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:00.865647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:00.990420 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:00.998045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f78ad346-e15d-47e7-8417-53f9c1eb0a1d tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.147166 Oct 14 03:12:00.998614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 341/661] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:00 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:01.797120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:01.798560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:01.805127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.805614 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.806579 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.807302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.807736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:01.807850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.808506 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:01.808705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.816309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.821063 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.821063 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.821063 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.821063 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.821404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.840855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f46d8f73-e696-4cfe-a4c5-fb704a3e585a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments/93f96370-ad94-4396-8933-7112970ff30a" status: 200 len: 194 microversion: 2.20 time: 0.047702 Oct 14 03:12:01.848986 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 321/662] 10.222.0.39 () {60 vars in 1454 bytes} [Fri Oct 14 03:12:01 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments/93f96370-ad94-4396-8933-7112970ff30a => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:12:01.911970 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:01.912453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:01.918586 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.919126 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.919560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.920420 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.920877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.921302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:01.972494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:01.981444 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3133ee57-436e-4c51-8186-8ebd4eeaf3b0 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.178054 Oct 14 03:12:01.982480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 342/663] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:01 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:01.987598 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-33c25abf-8d8f-4b44-9699-e662a095a871 req-8df2c4be-c141-4b8c-9b0b-7acfbbc82f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a498bd2-9d09-48f9-8430-a01fcb810321", "tag": "35720301-b893-4ece-93d6-8ee41b47d0ed"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:01.997167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-33c25abf-8d8f-4b44-9699-e662a095a871 req-8df2c4be-c141-4b8c-9b0b-7acfbbc82f11 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:01.997648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-33c25abf-8d8f-4b44-9699-e662a095a871 req-8df2c4be-c141-4b8c-9b0b-7acfbbc82f11 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:01.998107 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-33c25abf-8d8f-4b44-9699-e662a095a871 req-8df2c4be-c141-4b8c-9b0b-7acfbbc82f11 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.010290 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-33c25abf-8d8f-4b44-9699-e662a095a871 req-8df2c4be-c141-4b8c-9b0b-7acfbbc82f11 service nova] Creating event network-changed:35720301-b893-4ece-93d6-8ee41b47d0ed for instance 6a498bd2-9d09-48f9-8430-a01fcb810321 on hv-cinder-80152 Oct 14 03:12:02.017535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-33c25abf-8d8f-4b44-9699-e662a095a871 req-8df2c4be-c141-4b8c-9b0b-7acfbbc82f11 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033719 Oct 14 03:12:02.018156 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 343/664] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:02.027391 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:02.028095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:02.030403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lazy-loading 'services' on Instance uuid d95dafdb-f3bf-4f25-96bc-6595e7f52a89 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:02.034942 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:02.035426 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:02.035857 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.036549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:02.037001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:02.037464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.169072 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:02.176808 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4d5f2243-19fc-4aa2-9914-14329ce85589 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.157530 Oct 14 03:12:02.177384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 344/665] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:02 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:02.192032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0d1ce455-7cd6-461c-ab08-a6ba1649a167 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments/93f96370-ad94-4396-8933-7112970ff30a" status: 202 len: 0 microversion: 2.20 time: 0.283795 Oct 14 03:12:02.192615 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 322/666] 10.222.0.39 () {60 vars in 1457 bytes} [Fri Oct 14 03:12:01 2022] DELETE /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments/93f96370-ad94-4396-8933-7112970ff30a => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:02.201039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:02.203254 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:02.209638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:02.210173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:02.210611 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.211296 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:02.211748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:02.212198 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:02.242887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-62f94092-0463-4b0e-bdd0-e8a321999552 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045754 Oct 14 03:12:02.243638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 345/667] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Oct 14 03:12:02 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:12:03.007737 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:03.008378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:03.014672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.015194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.015631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.016377 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.016827 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.017248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.146274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:03.154412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-33fb440a-403c-4fec-b2c5-c72b5cc5f89f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1735 microversion: 2.1 time: 0.151560 Oct 14 03:12:03.154965 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 323/668] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:03 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:03.200722 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:03.201349 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:03.208270 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.208769 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.209197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.209902 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.210351 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.210768 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.256400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:03.258769 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:03.264798 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.265283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.265715 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.266568 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:03.267018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:03.267440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:03.299501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-694ee852-e1c3-4709-94ac-d50607382dcb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047567 Oct 14 03:12:03.300093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 324/669] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Oct 14 03:12:03 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:12:03.341337 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:03.349596 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-66f726cd-ed0c-4b4b-889b-fc34b29d7e96 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.153077 Oct 14 03:12:03.350191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 346/670] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:03 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:04.178751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.179435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.192601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.192601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.192601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.194833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.195321 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.195758 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.312155 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.315015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.321432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.321960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.322402 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.323096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.323553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.323976 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.329736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.338588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f18c0afb-24a9-41f9-8bc6-208f9ce748c4 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1715 microversion: 2.1 time: 0.163703 Oct 14 03:12:04.339285 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 325/671] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:04 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:04.355319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d67363f6-1f99-4a79-8e2e-5081d7161d53 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047135 Oct 14 03:12:04.355874 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 347/672] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Oct 14 03:12:04 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 03:12:04.373412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.374065 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.380449 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.380931 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.381367 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.382080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.382533 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.383373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.453062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.454119 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.460794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.461284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.461737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.462470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.462931 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.463360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.518773 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.530865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b906d148-f477-40e5-af5b-aa4fdaee7da0 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.157244 Oct 14 03:12:04.530865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 326/673] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:04 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:04.546823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] HTTP exception thrown: Cannot 'detach_volume' instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 while it is in vm_state rescued Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Request method failure captured: Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments/bbbcc886-4126-4672-933f-d7e590a1c90e HTTP/1.1 Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ-3La-kNpIaXxqS92x0RHqvXA16s4kGRVTPJOh9I4w33TN-8Kdm8KMswN-0sAhEnPB8F84xOWZd6MrRCKjPYbDU5wVTU3x-ea7nO92kSrT1cxdlWI2bwsOq6wbJoNZUr3bHwytcu5-fP6WVB8itTPTt4-KZM83SljPw5elkacbB5U Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:12:04.548477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_44d8a8798bc64aefadd52c30a21002ef"}]}] Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:12:04.555218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Cannot 'detach_volume' instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 while it is in vm_state rescued Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'server_id': '07426fa3-a9d9-4304-854a-b6a298b3f8c7', 'id': 'bbbcc886-4126-4672-933f-d7e590a1c90e'} Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:04.556147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 while it is in vm_state rescued Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 while it is in vm_state rescued Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:04.557697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Returning 409 to user: Cannot 'detach_volume' instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 while it is in vm_state rescued {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:04.558896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a0200a0c-e233-4b3f-b22a-e3efa30a908d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "DELETE /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments/bbbcc886-4126-4672-933f-d7e590a1c90e" status: 409 len: 152 microversion: 2.1 time: 0.101027 Oct 14 03:12:04.558896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 348/674] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:12:04 2022] DELETE /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments/bbbcc886-4126-4672-933f-d7e590a1c90e => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 14 03:12:04.561208 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:04.561734 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.568326 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.568845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.569283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.570055 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.570532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.570954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.588020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:04.799268 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3425d933-e8a2-4dcd-9d48-589f8582fcd9 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "POST /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/action" status: 202 len: 0 microversion: 2.1 time: 0.241926 Oct 14 03:12:04.799811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 327/675] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:12:04 2022] POST /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:12:04.808086 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:04.808706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:04.816009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.816498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.816937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.817628 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:04.818117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:04.818543 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:04.945648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:04.954047 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d18daff9-4e16-4707-93ee-80b2d8090943 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1723 microversion: 2.1 time: 0.149851 Oct 14 03:12:04.954611 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 349/676] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:04 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:05.369780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:05.372144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:05.378166 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.378638 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.379063 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.379741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.380194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.380612 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.410533 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5a3e037d-9be2-4a9f-8b09-ed56d5ed179a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045503 Oct 14 03:12:05.411080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 328/677] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Oct 14 03:12:05 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:12:05.551106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:05.551716 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:05.558159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.558638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.559077 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.559761 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.560330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.560752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.696370 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:05.706301 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7f3089c4-da5f-42a8-bd9e-baa3880dd17c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.159907 Oct 14 03:12:05.707039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 350/678] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:05 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:05.977402 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:05.978052 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:05.984008 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.984762 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.985195 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:05.986000 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:05.986442 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:05.989928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.122041 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:06.131300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4991b3e4-4ffa-44a0-b7bb-b50545168b41 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1723 microversion: 2.1 time: 0.157865 Oct 14 03:12:06.131869 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 329/679] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:05 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:06.422532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:06.425233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:06.427269 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=88 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:06.431884 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.439061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.439061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.439061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.439061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.439408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.463208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1916a904-99d3-4e26-a920-7bcf5593a6b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044609 Oct 14 03:12:06.463759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 351/680] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Oct 14 03:12:06 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:06.526703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:06.527206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:06.529083 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:06.530307 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:06.535062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.535542 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.535970 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.536687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.537136 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.537554 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.563118 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:06.787801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:06.788418 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:06.791710 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:06.795949 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.796432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.796863 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.797542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.798558 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.799098 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.833144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-51829b7c-5315-49f6-b5a8-0ed3b882cb03 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 204 len: 0 microversion: 2.20 time: 0.309903 Oct 14 03:12:06.833996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 330/681] 10.222.0.39 () {60 vars in 1280 bytes} [Fri Oct 14 03:12:06 2022] DELETE /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 03:12:06.845183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:06.845779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:06.853479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.854297 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.854732 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.855428 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:06.855886 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:06.856305 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:06.994298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.002939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fc5eb1b1-7623-4b0c-9ed1-019e82c1904c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.218945 Oct 14 03:12:07.003893 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 352/682] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:06 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:07.025143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.033698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.035149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.036307 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-086a5489-2bc5-4dbd-9919-ac6809b2e15f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.195868 Oct 14 03:12:07.036872 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 331/683] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:06 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:07.154132 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:07.154747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:07.161519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:07.162037 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:07.162470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.163154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:07.163605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:07.164025 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:07.299664 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:07.308011 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-36f1716a-046d-4ade-935e-e38a46c8f25c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1723 microversion: 2.1 time: 0.157733 Oct 14 03:12:07.308580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 353/684] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:07 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:08.026049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:08.026669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:08.033172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.033662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.034137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.034835 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.035291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.035717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.062155 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:08.062773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:08.070180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.070664 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.071103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.071875 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.072332 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.072760 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.220246 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:08.229443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-44c7e6b8-1ad7-497f-9a17-172dffe3d7f9 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.207360 Oct 14 03:12:08.241825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 332/685] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:08 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:08.253138 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:08.261497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:08.262980 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:08.264158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-03a13365-2ca8-493f-a882-0eaf728e4bce tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.206318 Oct 14 03:12:08.264855 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 354/686] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:08 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:08.331948 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:08.332677 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:08.339253 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.339840 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.340366 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.341143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:08.341672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:08.342191 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:08.486495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:08.494808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d81c06da-c5a5-4e74-bd97-80b162aff039 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1723 microversion: 2.1 time: 0.167024 Oct 14 03:12:08.495373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 333/687] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:08 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:09.255007 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:09.255007 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:09.260667 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.261147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.261579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.264566 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.265032 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.265466 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.295022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:09.295894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:09.313101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.314158 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.314585 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.315467 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.315952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.316376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.452625 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.460202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1f2d9218-915a-4987-a759-ae0777fb418e tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.210427 Oct 14 03:12:09.467551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 355/688] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:09 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:09.480752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.489613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.491098 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.492260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-213dace8-fc91-425c-bb54-cb5fce291e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.201267 Oct 14 03:12:09.492812 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 334/689] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:09 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:09.517565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:09.518215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:09.524245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.524723 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.525159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.525900 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:09.526360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:09.526782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:09.653029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:09.661810 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f5103bcd-0918-4d73-917b-3e72f10ec48b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1723 microversion: 2.1 time: 0.147460 Oct 14 03:12:09.661810 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 356/690] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:09 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:10.119703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-3fc4851f-cc26-44c3-bda6-772f527ca0b5 req-c00e805b-ee07-4b31-b8b0-3e246aa5798f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a498bd2-9d09-48f9-8430-a01fcb810321", "name": "network-vif-plugged", "status": "completed", "tag": "35720301-b893-4ece-93d6-8ee41b47d0ed"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:10.129371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-3fc4851f-cc26-44c3-bda6-772f527ca0b5 req-c00e805b-ee07-4b31-b8b0-3e246aa5798f service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.129948 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-3fc4851f-cc26-44c3-bda6-772f527ca0b5 req-c00e805b-ee07-4b31-b8b0-3e246aa5798f service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.130410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-3fc4851f-cc26-44c3-bda6-772f527ca0b5 req-c00e805b-ee07-4b31-b8b0-3e246aa5798f service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.141863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-3fc4851f-cc26-44c3-bda6-772f527ca0b5 req-c00e805b-ee07-4b31-b8b0-3e246aa5798f service nova] Creating event network-vif-plugged:35720301-b893-4ece-93d6-8ee41b47d0ed for instance 6a498bd2-9d09-48f9-8430-a01fcb810321 on hv-cinder-80152 Oct 14 03:12:10.146573 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-3fc4851f-cc26-44c3-bda6-772f527ca0b5 req-c00e805b-ee07-4b31-b8b0-3e246aa5798f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030647 Oct 14 03:12:10.147142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 335/691] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:10.482759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:10.483313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:10.490066 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.490551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.490985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.491708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.492162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.492582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.507180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:10.519602 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:10.522896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:10.526937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.527426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.527887 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.528590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.529039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.529460 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.675561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.700020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d3c0b790-e4f0-4aaf-a27e-4d0fd3c2d9bb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.221039 Oct 14 03:12:10.708180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 357/692] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:10 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:10.708180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:10.708180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:10.711955 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.712527 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.713090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.713537 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.716662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.717155 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.717584 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.725365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.726939 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.728153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-69c58143-9d21-4fcf-ad0b-37a187fb2e98 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1725 microversion: 2.20 time: 0.213937 Oct 14 03:12:10.728725 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 336/693] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:10 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:12:10.857231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:10.865818 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9773762d-2ce1-44b7-8e5d-9b7cdfd78eec tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1729 microversion: 2.1 time: 0.164210 Oct 14 03:12:10.866387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 358/694] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:10 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:10.888754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:10.889251 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:10.895937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.896419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.896846 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.900102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:10.900102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:10.900102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:10.981713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4c030cab-91f4-4eb1-8b3d-527853002678 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096652 Oct 14 03:12:10.982770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 337/695] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Oct 14 03:12:10 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:11.651428 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-d293b22b-9540-48d1-93b6-89896ae2e03b req-9e6a91bc-57f3-42f6-b0d3-a297f0be140d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95dafdb-f3bf-4f25-96bc-6595e7f52a89", "name": "network-vif-deleted", "tag": "e18b99a9-f003-40de-a7b1-30cc36ffa681"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:11.663575 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-d293b22b-9540-48d1-93b6-89896ae2e03b req-9e6a91bc-57f3-42f6-b0d3-a297f0be140d service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:11.664228 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-d293b22b-9540-48d1-93b6-89896ae2e03b req-9e6a91bc-57f3-42f6-b0d3-a297f0be140d service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:11.665004 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-d293b22b-9540-48d1-93b6-89896ae2e03b req-9e6a91bc-57f3-42f6-b0d3-a297f0be140d service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:11.677280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-d293b22b-9540-48d1-93b6-89896ae2e03b req-9e6a91bc-57f3-42f6-b0d3-a297f0be140d service nova] Creating event network-vif-deleted:e18b99a9-f003-40de-a7b1-30cc36ffa681 for instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 on hv-cinder-80152 Oct 14 03:12:11.682506 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-d293b22b-9540-48d1-93b6-89896ae2e03b req-9e6a91bc-57f3-42f6-b0d3-a297f0be140d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034604 Oct 14 03:12:11.683297 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 359/696] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:11.725546 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:11.727410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:11.734342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:11.735423 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:11.736050 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:11.737325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:11.738004 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:11.743640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:11.756123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:11.756889 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:11.769521 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:11.771299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:11.771752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:11.772469 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:11.774731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:11.775577 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.100679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.110939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.112716 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.115410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ed17953d-cf79-4b44-b36d-36506ee63902 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1658 microversion: 2.20 time: 0.363006 Oct 14 03:12:12.115410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 360/697] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:11 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1658 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:12.207517 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:12.215256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ffb69fd4-390e-4f5e-b287-4f0cee8d931c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.493482 Oct 14 03:12:12.215830 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 338/698] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:11 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:12.306529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-755f24fd-175c-4db6-970a-424f215a7307 req-b5a169cb-95bd-4c5a-a95d-52f68904407b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07426fa3-a9d9-4304-854a-b6a298b3f8c7", "tag": "04f7e24a-0bec-4456-bb1a-56489e3f78c6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:12.320962 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-755f24fd-175c-4db6-970a-424f215a7307 req-b5a169cb-95bd-4c5a-a95d-52f68904407b service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:12.322338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-755f24fd-175c-4db6-970a-424f215a7307 req-b5a169cb-95bd-4c5a-a95d-52f68904407b service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:12.323006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-755f24fd-175c-4db6-970a-424f215a7307 req-b5a169cb-95bd-4c5a-a95d-52f68904407b service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:12.338814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-755f24fd-175c-4db6-970a-424f215a7307 req-b5a169cb-95bd-4c5a-a95d-52f68904407b service nova] Creating event network-changed:04f7e24a-0bec-4456-bb1a-56489e3f78c6 for instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 on hv-cinder-80152 Oct 14 03:12:12.344002 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-755f24fd-175c-4db6-970a-424f215a7307 req-b5a169cb-95bd-4c5a-a95d-52f68904407b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042355 Oct 14 03:12:12.344668 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 361/699] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:13.140173 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:13.140781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:13.148578 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.149059 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.149489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.150207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.150658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.151082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.215946 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:13.224780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:13.226239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:13.227395 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0b47755b-6a26-45bb-8c85-b90d212b8009 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1658 microversion: 2.20 time: 0.091157 Oct 14 03:12:13.227976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 339/700] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:13 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1658 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:13.237563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:13.238371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:13.244958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.245446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.245903 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.246592 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:13.247048 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:13.247473 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:13.372995 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:13.380702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0e9960d4-b70e-4454-a08c-b694264e4698 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.147592 Oct 14 03:12:13.381265 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 362/701] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:13 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:14.253345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:14.253978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:14.260321 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.260801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.261254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.261969 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.262414 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.262866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.322747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.330683 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.332107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.340664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-95821ada-8bb7-4fed-bfaa-1bcc3f98dea8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1658 microversion: 2.20 time: 0.084465 Oct 14 03:12:14.340664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 340/702] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:14 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1658 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:14.358404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-bbdbd4c9-3814-4988-acf6-858c1bd49ccb req-8ef04725-f115-4ac8-b332-dd20257b265f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07426fa3-a9d9-4304-854a-b6a298b3f8c7", "tag": "04f7e24a-0bec-4456-bb1a-56489e3f78c6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:14.369083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-bbdbd4c9-3814-4988-acf6-858c1bd49ccb req-8ef04725-f115-4ac8-b332-dd20257b265f service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.369646 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-bbdbd4c9-3814-4988-acf6-858c1bd49ccb req-8ef04725-f115-4ac8-b332-dd20257b265f service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.370109 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-bbdbd4c9-3814-4988-acf6-858c1bd49ccb req-8ef04725-f115-4ac8-b332-dd20257b265f service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.382290 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-bbdbd4c9-3814-4988-acf6-858c1bd49ccb req-8ef04725-f115-4ac8-b332-dd20257b265f service nova] Creating event network-changed:04f7e24a-0bec-4456-bb1a-56489e3f78c6 for instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 on hv-cinder-80152 Oct 14 03:12:14.387235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-bbdbd4c9-3814-4988-acf6-858c1bd49ccb req-8ef04725-f115-4ac8-b332-dd20257b265f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032356 Oct 14 03:12:14.387797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 363/703] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:14.403747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:14.407313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:14.410795 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.411271 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.411698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.412371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:14.412819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:14.413233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:14.543325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:14.551776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-caf93d72-3ec1-475b-8d5d-b272b64b171c tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1314 microversion: 2.1 time: 0.151896 Oct 14 03:12:14.552338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 341/704] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:14 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:15.359226 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:15.360207 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:15.366722 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.367200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.367637 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.368321 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.368772 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.369190 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.399751 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.400222 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.400655 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.401097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lazy-loading 'fault' on Instance uuid d95dafdb-f3bf-4f25-96bc-6595e7f52a89 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:15.441912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.449817 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.451239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.452380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-96fdad7f-7879-422c-8776-130bf3fd569e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1372 microversion: 2.20 time: 0.097469 Oct 14 03:12:15.452956 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 364/705] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:15 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:15.574291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:15.574906 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:15.581357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.581889 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.582338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.583030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.583487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.583914 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.602896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:15.736322 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:15.745296 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-febd5061-e756-4006-9ff7-22419f376630 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1464 microversion: 2.1 time: 0.174736 Oct 14 03:12:15.746083 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 342/706] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:15 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:15.795162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:15.795663 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:15.802408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.802894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.803330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.804023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:15.804476 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:15.804898 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:15.832922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:16.098736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8fbb0f8a-aef6-4ffc-bfe8-fa4771354771 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 204 len: 0 microversion: 2.1 time: 0.307026 Oct 14 03:12:16.099330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 365/707] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:15 2022] DELETE /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:16.107554 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:16.108230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:16.115047 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.115517 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.115937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.116620 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.117068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.117489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.247131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.255232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d54e1d89-308c-4e49-8310-a67dbcc32615 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1470 microversion: 2.1 time: 0.151591 Oct 14 03:12:16.255793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 343/708] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:16 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:16.484370 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:16.489918 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:16.491726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.492204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.492640 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.493322 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.493793 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.494212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.525349 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:16.525861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:16.526296 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:16.526744 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lazy-loading 'fault' on Instance uuid d95dafdb-f3bf-4f25-96bc-6595e7f52a89 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:16.566898 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.575229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.576681 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:16.577937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a00f31a9-868c-4e59-84cf-0af7f223b0f4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1372 microversion: 2.20 time: 0.097928 Oct 14 03:12:16.578522 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 366/709] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:16 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:17.279145 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:17.279765 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:17.286695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.287175 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.287605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.288294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.288742 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.289163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.416005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:17.424363 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5412b38f-656f-4ac6-b55c-350b9129059a tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1470 microversion: 2.1 time: 0.149031 Oct 14 03:12:17.424958 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 344/710] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:17 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:17.603382 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:17.603998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:17.610661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.611798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.612258 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.613028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.613485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.613949 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.644617 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:17.645100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:17.645536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:17.646034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lazy-loading 'fault' on Instance uuid d95dafdb-f3bf-4f25-96bc-6595e7f52a89 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:17.694497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:17.702859 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:17.705148 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:17.706500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e8019438-a406-427c-aeb7-478f1a8c0bf3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 200 len: 1372 microversion: 2.20 time: 0.107082 Oct 14 03:12:17.707212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 367/711] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:17 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:18.446820 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:18.448083 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:18.455901 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.456702 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.457297 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.458188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.458915 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.459618 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.612164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:18.620659 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6a665aec-b3ea-4cae-9260-300c4db6c250 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1470 microversion: 2.1 time: 0.177859 Oct 14 03:12:18.634471 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 345/712] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:18 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:18.732354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:18.733593 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:18.740770 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.741253 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.741807 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.742511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.742955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.743375 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.757183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] HTTP exception thrown: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Request method failure captured: Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 HTTP/1.1 Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ-XmNkdoks1GQ-tEnOolYrAfXAe_V0NF5SqKOz8urLoHOgMLmxSTWBagnxY9yuV83St0mgb59FKGX05SX1vph3ppKQfIVEWQ3pBh2aNf8clqXLVAzzoKuUcKe8lD-RB2KQrznl9Kb7kx0HgQ7YQbD1SFXjy9n5tIcCVinUOqfkK4o Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:12:18.758816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_55f278e0f09c45ca8ab33cd9e102446c"}]}] Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: ab344e29f747423fb8766f2d8fbfef0b Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:12:18.760421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'd95dafdb-f3bf-4f25-96bc-6595e7f52a89'} Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:18.761185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:12:18.762415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:12:18.763475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Returning 404 to user: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:18.763475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d4dc9733-8ff9-441f-bb40-2fe8ce162928 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 404 len: 111 microversion: 2.20 time: 0.031984 Oct 14 03:12:18.763475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 368/713] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:18 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 14 03:12:18.770171 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c4477051-0456-4a14-abc1-b76ee2cc19f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '.version_select at 0x7f2beb7b9430>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:18.855739 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c4477051-0456-4a14-abc1-b76ee2cc19f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902552501" status: 204 len: 0 microversion: 2.20 time: 0.090253 Oct 14 03:12:18.856855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 346/714] 10.222.0.39 () {60 vars in 1262 bytes} [Fri Oct 14 03:12:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902552501 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 03:12:18.923999 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-1ad1d07a-ea3b-4704-b911-e66b1a3a2cb8 req-44bdda8a-0fd1-4db6-9916-4cfd094b0863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a498bd2-9d09-48f9-8430-a01fcb810321", "name": "network-vif-deleted", "tag": "35720301-b893-4ece-93d6-8ee41b47d0ed"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:18.933602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1ad1d07a-ea3b-4704-b911-e66b1a3a2cb8 req-44bdda8a-0fd1-4db6-9916-4cfd094b0863 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:18.934430 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1ad1d07a-ea3b-4704-b911-e66b1a3a2cb8 req-44bdda8a-0fd1-4db6-9916-4cfd094b0863 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:18.934672 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1ad1d07a-ea3b-4704-b911-e66b1a3a2cb8 req-44bdda8a-0fd1-4db6-9916-4cfd094b0863 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:18.948050 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-1ad1d07a-ea3b-4704-b911-e66b1a3a2cb8 req-44bdda8a-0fd1-4db6-9916-4cfd094b0863 service nova] Creating event network-vif-deleted:35720301-b893-4ece-93d6-8ee41b47d0ed for instance 6a498bd2-9d09-48f9-8430-a01fcb810321 on hv-cinder-80152 Oct 14 03:12:18.953525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-1ad1d07a-ea3b-4704-b911-e66b1a3a2cb8 req-44bdda8a-0fd1-4db6-9916-4cfd094b0863 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 Oct 14 03:12:18.954411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 369/715] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:19.646362 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:19.647086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:19.656066 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.656619 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.657124 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.657957 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.658486 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.659032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.700438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:19.700996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:19.701490 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:19.702020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lazy-loading 'fault' on Instance uuid 6a498bd2-9d09-48f9-8430-a01fcb810321 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:19.748110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7ee85ee112042f1abe5962d06d64ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2534240ab74afbae7843231469486a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:19.756873 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-df74c226-1c81-4d00-a968-3d422e5be6eb tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 200 len: 1304 microversion: 2.1 time: 0.116346 Oct 14 03:12:19.758539 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 347/716] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:19 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:19.778734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f6bdae0c-05b9-4b98-ad5e-9b5c00cce4e0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'create', calling method: .version_select at 0x7f2beb8c2ee0>, body: {"keypair": {"name": "tempest-keypair-906154666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpk3iUOxWjchj0JzY/49XU2p70rey+dHJ8Q6KVvDE//doTaZfQEZVgW3Vw7QdtLVlTJ7DOvwKqURBpvCNM0WXzxhLbc96bzDTn3StMhkA54aZ/KRvzJJ3tMnMSuh0pXOQ=="}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:19.793915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-f6bdae0c-05b9-4b98-ad5e-9b5c00cce4e0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Getting quotas for project 55f278e0f09c45ca8ab33cd9e102446c. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:19.797668 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-f6bdae0c-05b9-4b98-ad5e-9b5c00cce4e0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Getting quotas for user ab344e29f747423fb8766f2d8fbfef0b and project 55f278e0f09c45ca8ab33cd9e102446c. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:19.887897 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f6bdae0c-05b9-4b98-ad5e-9b5c00cce4e0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.113900 Oct 14 03:12:19.888489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 370/717] 10.222.0.39 () {62 vars in 1200 bytes} [Fri Oct 14 03:12:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 14 03:12:20.780770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:20.782256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] [instance: 6a498bd2-9d09-48f9-8430-a01fcb810321] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:20.789069 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.789808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.790244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.790930 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:20.791376 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:20.791790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:20.806018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] HTTP exception thrown: Instance 6a498bd2-9d09-48f9-8430-a01fcb810321 could not be found. Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Request method failure captured: Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 HTTP/1.1 Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNN5_rCapp7QPnPzh0pPPQogWpJzmcOTXSlGA9MIrU1Cxs8HskBL8b5zNacwnbNoLgv-0urgHHvqIb6dS4ROIM2UJc3nRGPjCzbNTJcQa4DlPTurDETJt-TnAgQGp5KHdPs9AVxzYPL7eq3IXN28XoaS_U73Ndz_lwlxjvtpiuP0EQI Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: bb2534240ab74afbae7843231469486a Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-VolumesNegativeTest-395427033 Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:12:20.807656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bb2534240ab74afbae7843231469486a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bb2534240ab74afbae7843231469486a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bb2534240ab74afbae7843231469486a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bb2534240ab74afbae7843231469486a"}]}] Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-VolumesNegativeTest-395427033 Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: bb2534240ab74afbae7843231469486a Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-VolumesNegativeTest-395427033 Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-VolumesNegativeTest-395427033-project Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: e7ee85ee112042f1abe5962d06d64ce0 Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-VolumesNegativeTest-395427033-project Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 6a498bd2-9d09-48f9-8430-a01fcb810321 could not be found. Oct 14 03:12:20.809338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '6a498bd2-9d09-48f9-8430-a01fcb810321'} Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a498bd2-9d09-48f9-8430-a01fcb810321 could not be found. Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:20.810357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a498bd2-9d09-48f9-8430-a01fcb810321 could not be found. Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a498bd2-9d09-48f9-8430-a01fcb810321 could not be found. Oct 14 03:12:20.811833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:20.813323 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] Returning 404 to user: Instance 6a498bd2-9d09-48f9-8430-a01fcb810321 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:20.813323 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-33cfdb6a-59e1-44a2-a0bc-90f8b64dff72 tempest-VolumesNegativeTest-395427033 tempest-VolumesNegativeTest-395427033-project] 10.222.0.39 "GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321" status: 404 len: 111 microversion: 2.1 time: 0.032387 Oct 14 03:12:20.813323 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 348/718] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:20 2022] GET /compute/v2.1/servers/6a498bd2-9d09-48f9-8430-a01fcb810321 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:12:22.218627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1806905287", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc7d519e-6d73-4b0e-803b-556cfc3b6498"}], "security_groups": [{"name": "tempest-securitygroup--516554113"}], "key_name": "tempest-keypair-906154666", "user_data": "}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:22.321900 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] validate_networks() for [('dc7d519e-6d73-4b0e-803b-556cfc3b6498', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:12:22.688200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:12:22.688640 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:12:22.689613 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:12:22.690054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:12:22.690459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:12:22.699021 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.699493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.703185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.703185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:22.703185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:22.703185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:22.718643 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Getting quotas for project 55f278e0f09c45ca8ab33cd9e102446c. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:22.722924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Getting quotas for user ab344e29f747423fb8766f2d8fbfef0b and project 55f278e0f09c45ca8ab33cd9e102446c. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:22.734048 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:12:22.736769 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:12:22.898710 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-be0c3d08-c6d4-434a-b7d9-391a2122b088 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.684941 Oct 14 03:12:22.899370 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 371/719] 10.222.0.39 () {62 vars in 1188 bytes} [Fri Oct 14 03:12:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 14 03:12:22.910453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-aea7f2de-e96e-4b12-bbe8-63e893944d9e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:22.911068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-aea7f2de-e96e-4b12-bbe8-63e893944d9e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:22.980413 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-aea7f2de-e96e-4b12-bbe8-63e893944d9e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:22.990906 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-aea7f2de-e96e-4b12-bbe8-63e893944d9e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:22.992447 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-aea7f2de-e96e-4b12-bbe8-63e893944d9e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:22.993578 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-aea7f2de-e96e-4b12-bbe8-63e893944d9e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1281 microversion: 2.20 time: 0.086970 Oct 14 03:12:22.994145 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 349/720] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:22 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:24.019340 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:24.019959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:24.028094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.028666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.029181 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.030249 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:24.030778 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:24.031325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:24.130571 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:24.138874 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:24.140443 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:24.146927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f8bae5f3-0a4e-40e1-a473-abc57cf67e52 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1285 microversion: 2.20 time: 0.132372 Oct 14 03:12:24.147515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 372/721] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:24 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:25.170933 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:25.171537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:25.182500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:25.182990 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:25.183861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:25.184575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:25.185035 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:25.185523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:25.427915 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:25.436530 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:25.438100 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:25.439265 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b4a12672-2540-434f-b775-b8c89b081b9f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1341 microversion: 2.20 time: 0.272169 Oct 14 03:12:25.439925 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 350/722] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:25 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1341 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:26.469393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:26.474349 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:26.477713 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.478272 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.478898 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.479646 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.480088 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.480675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.669719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:26.678880 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:26.680505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:26.682396 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b37aa8e4-e8a2-445d-bc32-8b4bc277dae5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1406 microversion: 2.20 time: 0.217534 Oct 14 03:12:26.683627 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 373/723] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:26 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:26.936961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-489be6e2-889d-4c0d-adc6-c9836705b38d req-10f487f4-cf1c-4bdb-bec5-b1d0b0586e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c372d0ca-25ac-43bd-b519-1700473cb118", "tag": "d2229097-29e6-40af-97ca-3612bf109084"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:26.947213 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:26.949248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-489be6e2-889d-4c0d-adc6-c9836705b38d req-10f487f4-cf1c-4bdb-bec5-b1d0b0586e38 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:26.949734 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-489be6e2-889d-4c0d-adc6-c9836705b38d req-10f487f4-cf1c-4bdb-bec5-b1d0b0586e38 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:26.950171 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-489be6e2-889d-4c0d-adc6-c9836705b38d req-10f487f4-cf1c-4bdb-bec5-b1d0b0586e38 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:26.963048 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-489be6e2-889d-4c0d-adc6-c9836705b38d req-10f487f4-cf1c-4bdb-bec5-b1d0b0586e38 service nova] Creating event network-changed:d2229097-29e6-40af-97ca-3612bf109084 for instance c372d0ca-25ac-43bd-b519-1700473cb118 on hv-cinder-80152 Oct 14 03:12:26.968344 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-489be6e2-889d-4c0d-adc6-c9836705b38d req-10f487f4-cf1c-4bdb-bec5-b1d0b0586e38 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035357 Oct 14 03:12:26.969237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 351/724] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:27.708552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:27.709160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:27.715331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:27.715816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:27.716245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:27.716942 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:27.717384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:27.717825 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:27.847051 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:27.855083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:27.856547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:27.857648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1dd76632-9827-43d1-a805-f18f8e7444af tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1406 microversion: 2.20 time: 0.153264 Oct 14 03:12:27.858239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 374/725] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:27 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:28.883665 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:28.884369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:28.891768 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:28.895072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:28.895072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:28.895072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:28.895072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:28.895425 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:29.030138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:29.038750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:29.040158 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:29.041258 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d2cf0697-2990-49b9-978c-e984419747e8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1406 microversion: 2.20 time: 0.161888 Oct 14 03:12:29.041834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 352/726] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:28 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:30.066730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:30.067339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:30.073707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.074217 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.074649 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.075347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.075783 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.076204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.202563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:30.210509 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:30.211951 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:30.213085 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bd593ca3-32f5-4b50-8084-7122d4cec4c6 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1406 microversion: 2.20 time: 0.150300 Oct 14 03:12:30.213638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 375/727] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:30 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:30.828867 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-bd62bd72-dd86-4491-98ec-92a093545ed6 req-da1aeedc-9402-4c4e-a645-2a3f4b8d7a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372d0ca-25ac-43bd-b519-1700473cb118", "name": "network-vif-plugged", "status": "completed", "tag": "d2229097-29e6-40af-97ca-3612bf109084"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:30.839650 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-bd62bd72-dd86-4491-98ec-92a093545ed6 req-da1aeedc-9402-4c4e-a645-2a3f4b8d7a17 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:30.840127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-bd62bd72-dd86-4491-98ec-92a093545ed6 req-da1aeedc-9402-4c4e-a645-2a3f4b8d7a17 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:30.840711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-bd62bd72-dd86-4491-98ec-92a093545ed6 req-da1aeedc-9402-4c4e-a645-2a3f4b8d7a17 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:30.851902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-bd62bd72-dd86-4491-98ec-92a093545ed6 req-da1aeedc-9402-4c4e-a645-2a3f4b8d7a17 service nova] Creating event network-vif-plugged:d2229097-29e6-40af-97ca-3612bf109084 for instance c372d0ca-25ac-43bd-b519-1700473cb118 on hv-cinder-80152 Oct 14 03:12:30.856625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-bd62bd72-dd86-4491-98ec-92a093545ed6 req-da1aeedc-9402-4c4e-a645-2a3f4b8d7a17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031549 Oct 14 03:12:30.857197 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 353/728] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:12:31.237560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:31.238203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:31.245185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.245724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:31.246119 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:31.246842 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:31.247293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:31.247707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:31.263369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:31.374654 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:31.382949 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:31.384371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:31.385461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c68a4eb0-cfaf-421a-8e20-58999d65f087 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1406 microversion: 2.20 time: 0.152007 Oct 14 03:12:31.386096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 376/729] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:31 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:32.411163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:32.411867 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:32.417989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:32.418477 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:32.418918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:32.419620 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:32.420074 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:32.420501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:32.553714 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:32.561766 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:32.563182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:32.564278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f7ff8e2c-b7c7-4f3e-a3a1-f7c9dd4ee981 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1406 microversion: 2.20 time: 0.157918 Oct 14 03:12:32.564834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 354/730] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:32 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:33.589477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:33.590251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:33.592382 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:33.593053 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=10 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:33.598222 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.598589 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.599028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.599730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.600185 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.601100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.729743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:33.738543 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:33.740158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:33.741955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5a95429f-65fa-4e6d-9d02-3e788d718b86 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1599 microversion: 2.20 time: 0.156715 Oct 14 03:12:33.746783 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 377/731] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:12:33 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:12:33.766972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:33.767464 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:33.769741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:33.776260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.784277 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.784277 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.784277 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.784277 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.784638 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.803221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:33.806096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:33.812734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.813384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.813840 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.814534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.814983 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.815400 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.845595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1edf6a29-bdd0-4033-8b06-28534ecc4747 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046318 Oct 14 03:12:33.846193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 378/732] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:33 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 14 03:12:33.859559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e8b2d4e3-85bb-4cc6-b58b-afd81cc079f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096614 Oct 14 03:12:33.860448 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 355/733] 10.222.0.39 () {60 vars in 1316 bytes} [Fri Oct 14 03:12:33 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:12:33.913382 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:33.914060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:33.920404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.920887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.921319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.922048 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:33.922497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:33.922916 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:33.950650 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:34.158377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:34.233788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-86ed659d-1c4c-4c4d-a061-938b3f1c466c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 204 len: 0 microversion: 2.1 time: 0.324339 Oct 14 03:12:34.234338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 379/734] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:33 2022] DELETE /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:34.242866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:34.250346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:34.250346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:34.250535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:34.250942 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:34.251631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:34.252084 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:34.252502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:34.422770 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:34.430418 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9cc2862b-3d26-4a16-825b-0c76fd4078b5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1673 microversion: 2.1 time: 0.191586 Oct 14 03:12:34.431269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 356/735] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:34 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:35.110573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-e51d5f33-aead-4cc4-a443-b3bdf6a88a98 req-392dbf5c-2069-4ef1-abac-96f0be69e593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c372d0ca-25ac-43bd-b519-1700473cb118", "tag": "d2229097-29e6-40af-97ca-3612bf109084"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:35.121364 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-e51d5f33-aead-4cc4-a443-b3bdf6a88a98 req-392dbf5c-2069-4ef1-abac-96f0be69e593 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.121881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-e51d5f33-aead-4cc4-a443-b3bdf6a88a98 req-392dbf5c-2069-4ef1-abac-96f0be69e593 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.122313 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-e51d5f33-aead-4cc4-a443-b3bdf6a88a98 req-392dbf5c-2069-4ef1-abac-96f0be69e593 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.133360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-e51d5f33-aead-4cc4-a443-b3bdf6a88a98 req-392dbf5c-2069-4ef1-abac-96f0be69e593 service nova] Creating event network-changed:d2229097-29e6-40af-97ca-3612bf109084 for instance c372d0ca-25ac-43bd-b519-1700473cb118 on hv-cinder-80152 Oct 14 03:12:35.138284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-e51d5f33-aead-4cc4-a443-b3bdf6a88a98 req-392dbf5c-2069-4ef1-abac-96f0be69e593 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032108 Oct 14 03:12:35.138877 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 380/736] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:35.454926 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:35.455481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:35.462080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.462791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.463254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.463966 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:35.464423 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:35.464850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:35.593846 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:35.602095 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ec585e6d-9981-4a05-b1f3-181b7a61b1d1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1673 microversion: 2.1 time: 0.151613 Oct 14 03:12:35.602669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 357/737] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:35 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:36.628933 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:36.629550 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:36.636269 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:36.636752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:36.637189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:36.637902 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:36.638358 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:36.638783 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:36.768801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:36.776441 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3f43bb74-35db-4067-a81c-b471051ce1a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1673 microversion: 2.1 time: 0.152423 Oct 14 03:12:36.777008 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 381/738] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:36 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:37.800470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:37.801206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:37.808511 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:37.810470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:37.810928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:37.811657 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:37.812127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:37.812551 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:37.878356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:37.887331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7e3c97ab-d851-47c1-a8e9-e91ebdc276b2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1605 microversion: 2.1 time: 0.090801 Oct 14 03:12:37.887991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 358/739] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:37 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1605 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:38.129477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-ef1086ed-4add-4077-9dbc-b99d59af65de req-5e27ef63-f90b-477f-a748-a7b733913362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258e7a24-1f44-4662-b9b0-4f35c319a2d2", "name": "network-vif-deleted", "tag": "071c08ed-047d-41ca-80e6-701785e75787"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:38.140754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-ef1086ed-4add-4077-9dbc-b99d59af65de req-5e27ef63-f90b-477f-a748-a7b733913362 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:38.141443 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-ef1086ed-4add-4077-9dbc-b99d59af65de req-5e27ef63-f90b-477f-a748-a7b733913362 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:38.142188 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-ef1086ed-4add-4077-9dbc-b99d59af65de req-5e27ef63-f90b-477f-a748-a7b733913362 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:38.154148 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-ef1086ed-4add-4077-9dbc-b99d59af65de req-5e27ef63-f90b-477f-a748-a7b733913362 service nova] Creating event network-vif-deleted:071c08ed-047d-41ca-80e6-701785e75787 for instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 on hv-cinder-80152 Oct 14 03:12:38.160150 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-ef1086ed-4add-4077-9dbc-b99d59af65de req-5e27ef63-f90b-477f-a748-a7b733913362 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034284 Oct 14 03:12:38.160736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 382/740] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:38.840797 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:38.841434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:38.848178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:38.848736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:38.849179 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:38.849917 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:38.850964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:38.851392 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:38.878705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c5f8b036-7448-4b1c-9141-7cd203e94765 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/ips" status: 200 len: 150 microversion: 2.1 time: 0.041600 Oct 14 03:12:38.879290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 359/741] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:12:38 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:38.912202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:38.913647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:38.920782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:38.921470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:38.922292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:38.923215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:38.923915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:38.924501 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:38.962515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:38.967674 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:38.967674 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:38.967674 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lazy-loading 'fault' on Instance uuid 258e7a24-1f44-4662-b9b0-4f35c319a2d2 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:39.022705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:39.030721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d69e015a-29b1-4bb6-ae80-030e7bc53e46 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 200 len: 1326 microversion: 2.1 time: 0.122743 Oct 14 03:12:39.031526 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 383/742] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:38 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:40.053936 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:40.054583 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:40.061017 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:40.061499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:40.061979 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:40.062665 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:40.063120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:40.063538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:40.076952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] HTTP exception thrown: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Request method failure captured: Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 HTTP/1.1 Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNKBPksE4oWnYQ-3VWpnw8PZLzHdWBKdybCJIRXbef7HW5UgYarsATq5W8eARtcoIBd3AQ94Xp5wrIFjFMKFzGlNjhhHUrodqL6-B4Y8tzyihZoKOAPWT1S8y4Eu7mFBHI53Ikj-rqIubqmVPGK9YwIxtQVh89ZXI7XVRe3iIymEP1k Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:12:40.078592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5470d8ee28f74b4eb385a90c33a514b8"}]}] Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: fb1c279c2f7f404ab9c846a3ba594886 Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:12:40.080087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '258e7a24-1f44-4662-b9b0-4f35c319a2d2'} Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:40.081011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:12:40.082288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:40.083338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Returning 404 to user: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:40.083338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bc2dfcbf-e12e-4205-bda2-c23c3a1c51a2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 404 len: 111 microversion: 2.1 time: 0.029932 Oct 14 03:12:40.083338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 360/743] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:40 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:12:40.089329 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5abdbbaa-e11b-4d31-be19-9ca45b69f6b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '.version_select at 0x7f2beb859af0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:40.156495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5abdbbaa-e11b-4d31-be19-9ca45b69f6b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-19140152" status: 202 len: 0 microversion: 2.1 time: 0.070894 Oct 14 03:12:40.157066 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 384/744] 10.222.0.39 () {58 vars in 1215 bytes} [Fri Oct 14 03:12:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-19140152 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:12:40.595981 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a4108ae-9819-4237-80ab-454fc42837be"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:40.598406 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:40.604187 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:40.604822 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:40.605440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:40.606269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:40.606591 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:40.607010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:40.941084 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-671d5f8d-16a1-476b-8cfd-b86d78f32bbf tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'create', calling method: .version_select at 0x7f2beb86e670>, body: {"keypair": {"name": "tempest-keypair-822883232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6a/gQZY04jcs3MrDMJg0xxtq49QKQNWv/vla611Eusn0EBdAHheuulPqoNCSAz2n/5J3DA8XtYFBNGYjb3e1Q3Ddlz5hufOR05btvpFSXRgSovcUqXZyEI/LUQqnHTQQ=="}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:40.957092 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-671d5f8d-16a1-476b-8cfd-b86d78f32bbf tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Getting quotas for project 5470d8ee28f74b4eb385a90c33a514b8. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:40.961039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-671d5f8d-16a1-476b-8cfd-b86d78f32bbf tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Getting quotas for user fb1c279c2f7f404ab9c846a3ba594886 and project 5470d8ee28f74b4eb385a90c33a514b8. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:41.054700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-671d5f8d-16a1-476b-8cfd-b86d78f32bbf tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117319 Oct 14 03:12:41.055211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 385/745] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:12:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:41.391838 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-84c1835a-b533-4d44-a38e-2dd8d4609b40 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799636 Oct 14 03:12:41.398449 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 361/746] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:12:40 2022] POST /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments => generated 194 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:43.210027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1276531091", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "706c2be8-801d-4fd3-a7af-a476e6a9ec99"}], "security_groups": [{"name": "tempest-securitygroup--1790827347"}], "key_name": "tempest-keypair-822883232", "user_data": "}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:43.310581 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] validate_networks() for [('706c2be8-801d-4fd3-a7af-a476e6a9ec99', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:12:43.672208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:12:43.672625 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:12:43.673090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:12:43.673490 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:12:43.673968 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:12:43.683172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:43.683640 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:43.684064 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:43.684777 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:43.685225 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:43.685643 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:43.701998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Getting quotas for project 5470d8ee28f74b4eb385a90c33a514b8. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:12:43.705870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Getting quotas for user fb1c279c2f7f404ab9c846a3ba594886 and project 5470d8ee28f74b4eb385a90c33a514b8. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:12:43.716507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:12:43.718820 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:12:43.877314 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5cadc9c1-0f7d-42ba-80cb-ade7aa15961e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.672216 Oct 14 03:12:43.877998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 386/747] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:12:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:12:43.889575 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9d70eab9-03bb-4e4e-8e8b-9cf9e9bd40ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:43.891944 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9d70eab9-03bb-4e4e-8e8b-9cf9e9bd40ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:43.944540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9d70eab9-03bb-4e4e-8e8b-9cf9e9bd40ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:43.951380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9d70eab9-03bb-4e4e-8e8b-9cf9e9bd40ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1237 microversion: 2.1 time: 0.066007 Oct 14 03:12:43.951947 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 362/748] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:43 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:44.975829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:44.976345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:44.983003 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:44.983486 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:44.983917 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:44.984599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:44.985304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:44.985720 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:45.047607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:45.055966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1a5c96ae-f7f9-4d26-ab9a-37801ba72a77 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1241 microversion: 2.1 time: 0.085209 Oct 14 03:12:45.056594 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 387/749] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:44 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:46.196483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:46.197698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:46.204875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:46.205543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:46.206002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:46.206694 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:46.207144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:46.207736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:46.212294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:46.277871 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:46.285705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5fce12d9-c962-4e8c-b5d8-f2bef7c39137 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1307 microversion: 2.1 time: 0.210890 Oct 14 03:12:46.286603 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 363/750] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:46 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:47.308416 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:47.309058 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:47.315674 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.319739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.319739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.319739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.319739 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.320128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.447867 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:47.455595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d8d06742-958a-4aeb-a82d-73c327aa6078 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.151070 Oct 14 03:12:47.456160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 388/751] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:47 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:47.793804 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-4e786bd7-0c7e-4eaa-bada-c016099b77dc req-b6123bed-ef58-494f-827f-96bb79b80923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bec501f-50e0-40ea-ba38-c2df09fd439b", "tag": "4a6bff08-0d49-4863-be8c-5097b81b1188"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:47.805114 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-4e786bd7-0c7e-4eaa-bada-c016099b77dc req-b6123bed-ef58-494f-827f-96bb79b80923 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:47.805587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-4e786bd7-0c7e-4eaa-bada-c016099b77dc req-b6123bed-ef58-494f-827f-96bb79b80923 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:47.806050 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-4e786bd7-0c7e-4eaa-bada-c016099b77dc req-b6123bed-ef58-494f-827f-96bb79b80923 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:47.816899 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-4e786bd7-0c7e-4eaa-bada-c016099b77dc req-b6123bed-ef58-494f-827f-96bb79b80923 service nova] Creating event network-changed:4a6bff08-0d49-4863-be8c-5097b81b1188 for instance 7bec501f-50e0-40ea-ba38-c2df09fd439b on hv-cinder-80152 Oct 14 03:12:47.822354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-4e786bd7-0c7e-4eaa-bada-c016099b77dc req-b6123bed-ef58-494f-827f-96bb79b80923 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032277 Oct 14 03:12:47.822950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 364/752] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:48.480495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:48.481039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:48.487731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:48.488224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:48.488660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:48.489349 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:48.489830 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:48.490294 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:48.622289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:48.631626 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3d8ea9cd-9532-4acd-8917-6e4d880dd641 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.154543 Oct 14 03:12:48.645216 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 389/753] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:48 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:49.136779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a4108ae-9819-4237-80ab-454fc42837be"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:49.139252 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:49.145628 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.146129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.146564 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.147239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.147687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.148103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.223825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Invalid volume: volume 6a4108ae-9819-4237-80ab-454fc42837be is already attached to instances: ccd7272a-6200-4e43-a875-486a9dfdf4de Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: POST /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments HTTP/1.1 Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 74 Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:12:49.225547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {"volumeAttachment": {"volumeId": "6a4108ae-9819-4237-80ab-454fc42837be"}} Oct 14 03:12:49.227399 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Invalid volume: volume 6a4108ae-9819-4237-80ab-454fc42837be is already attached to instances: ccd7272a-6200-4e43-a875-486a9dfdf4de Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'server_id': 'ccd7272a-6200-4e43-a875-486a9dfdf4de', 'body': {'volumeAttachment': {'volumeId': '6a4108ae-9819-4237-80ab-454fc42837be'}}} Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6a4108ae-9819-4237-80ab-454fc42837be is already attached to instances: ccd7272a-6200-4e43-a875-486a9dfdf4de Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:49.228127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6a4108ae-9819-4237-80ab-454fc42837be is already attached to instances: ccd7272a-6200-4e43-a875-486a9dfdf4de Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:12:49.229505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:12:49.230746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:12:49.230746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:12:49.230746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:12:49.230746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6a4108ae-9819-4237-80ab-454fc42837be is already attached to instances: ccd7272a-6200-4e43-a875-486a9dfdf4de Oct 14 03:12:49.230746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:12:49.230746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 400 to user: Invalid volume: volume 6a4108ae-9819-4237-80ab-454fc42837be is already attached to instances: ccd7272a-6200-4e43-a875-486a9dfdf4de {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:12:49.230746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e2433007-86d4-4c35-96a9-85c112639330 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095732 Oct 14 03:12:49.230746 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 365/754] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:12:49 2022] POST /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:12:49.292267 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:49.293748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:49.298584 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.299066 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.299502 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.300184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.300639 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.301055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.380041 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'services' on Instance uuid ccd7272a-6200-4e43-a875-486a9dfdf4de {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:49.564432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c2cb8359-11fe-486b-b7ba-6df759c1718b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments/6a4108ae-9819-4237-80ab-454fc42837be" status: 202 len: 0 microversion: 2.1 time: 0.275534 Oct 14 03:12:49.565051 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 390/755] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:12:49 2022] DELETE /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments/6a4108ae-9819-4237-80ab-454fc42837be => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:12:49.573122 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:49.575300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:49.582084 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.582572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.583009 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.583708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.584164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.585598 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.613523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-82f07d92-270c-4f21-84d6-85163d764815 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 Oct 14 03:12:49.614094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 366/756] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:49 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:49.655560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:49.656252 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:49.662887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.663368 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.663824 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.664534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:49.664985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:49.665406 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:49.793838 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:49.801341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-26f8ed23-e86c-44ad-8bb7-bf84ef7924aa tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.150024 Oct 14 03:12:49.801921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 391/757] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:49 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:50.626095 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:50.628267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:50.634655 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:50.635130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:50.635563 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:50.636242 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:50.636692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:50.637115 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:50.667963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6e69d42c-bcfb-40f2-9bc9-791957a954ff tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Oct 14 03:12:50.668521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 367/758] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:50 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:50.824191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:50.824904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:50.831532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:50.832006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:50.832436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:50.833117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:50.833565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:50.834018 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:50.964102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:50.971680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ab796136-496e-4469-8a0d-5bda855008af tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.151507 Oct 14 03:12:50.972262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 392/759] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:50 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:51.340215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:51.340714 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:51.346787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.347257 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.347693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.348384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.348841 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.349269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.430052 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lazy-loading 'services' on Instance uuid 07426fa3-a9d9-4304-854a-b6a298b3f8c7 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:51.634439 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-75dc93a6-29da-4e3d-9f67-37efb192153c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "DELETE /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments/bbbcc886-4126-4672-933f-d7e590a1c90e" status: 202 len: 0 microversion: 2.1 time: 0.297855 Oct 14 03:12:51.635171 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 368/760] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:12:51 2022] DELETE /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments/bbbcc886-4126-4672-933f-d7e590a1c90e => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:12:51.643304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:51.645547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:51.651435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.651929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.652372 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.653070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.653529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.653989 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.681653 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:51.683842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:51.683973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-03a72181-5b73-44d6-8a4f-3e5ea010e4bb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Oct 14 03:12:51.684526 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 393/761] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:51 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:51.690223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.690703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.691129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.691824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.692269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.692685 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.721123 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6e9bd24b-cc5e-4f1e-85ba-a174a6fb0488 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044497 Oct 14 03:12:51.721679 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 369/762] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:51 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 14 03:12:51.785127 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:51.785629 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:51.792265 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.792751 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.793188 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.793908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:51.794376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:51.794803 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:51.810225 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:51.820553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:51.994737 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:51.995266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:52.001066 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.003776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.003776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.003776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.003776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.004150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.135162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:52.142783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6ad07b03-186f-4981-b223-54b7d87abdfb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.152691 Oct 14 03:12:52.143345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 370/763] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:51 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:52.161211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-56ef04f3-92bf-49b3-b1b2-03b9bb8bc10f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 204 len: 0 microversion: 2.1 time: 0.379787 Oct 14 03:12:52.161847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 394/764] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:51 2022] DELETE /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:52.170070 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:52.170680 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:52.176509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.176988 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.177427 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.178148 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.178603 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.179023 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.305868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:52.313528 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3cf79a27-c260-4000-b9b0-a35721f64024 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1682 microversion: 2.1 time: 0.147126 Oct 14 03:12:52.314125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 371/765] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:52 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:52.696267 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:52.698545 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:52.704497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.704981 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.705422 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.706143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:52.706602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:52.707028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:52.736941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6cf5ccd0-e504-4b4e-92c7-34d74474f05e tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Oct 14 03:12:52.737715 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 395/766] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:52 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:53.165707 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:53.166348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:53.172674 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.173153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.173590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.174318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.174767 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.175187 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.303899 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:53.311669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ea837b60-f648-46b5-933a-d43d422387bc tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.149745 Oct 14 03:12:53.312233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 372/767] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:53 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:53.336479 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:53.337317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:53.343906 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.344456 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.344976 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.345789 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.346245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.346662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.478895 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:53.486780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a317943c-520f-4ac0-a008-aebb524089c5 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1682 microversion: 2.1 time: 0.154303 Oct 14 03:12:53.487338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 396/768] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:53 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:53.750041 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:53.752304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:53.758223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.758703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.759137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.759820 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:53.760269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:53.760690 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:53.789921 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-dfcee5a2-c0fa-4095-a044-6c0864e05dce tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Oct 14 03:12:53.790470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 373/769] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:53 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:54.334480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:54.335102 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:54.337094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:54.338061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=10 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:54.343288 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:54.347163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:54.347163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.347163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:54.347163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:54.347542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.478305 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:54.486517 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2766cfbc-f46a-44c5-b225-2ff23c577346 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.156068 Oct 14 03:12:54.487113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 397/770] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:54 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:54.510469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:54.511042 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:54.513067 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:54.518295 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:54.518828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:54.519425 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.520150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:54.520609 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:54.521033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.653641 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:54.661586 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-03880b50-abb1-4e0a-a49f-bae74a01ceba tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1682 microversion: 2.1 time: 0.155089 Oct 14 03:12:54.662185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 374/771] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:54 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:54.803050 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:54.805354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:54.812197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:54.812682 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:54.813113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.813852 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:54.814309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:54.814726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.846914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-813ec389-41d8-49f2-ac68-a9a93c2d7915 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048355 Oct 14 03:12:54.847691 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 398/772] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:12:54 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 14 03:12:54.934440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:54.934941 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:54.940992 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:54.941540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:54.944477 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.945417 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:54.946078 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:54.946674 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:54.978694 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:12:55.023391 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-3caa996a-a7e7-4bf9-99b7-e1563a8aa4cd req-214aebc9-2d74-49af-ba21-5210e703c8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec501f-50e0-40ea-ba38-c2df09fd439b", "name": "network-vif-plugged", "status": "completed", "tag": "4a6bff08-0d49-4863-be8c-5097b81b1188"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:55.035574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-3caa996a-a7e7-4bf9-99b7-e1563a8aa4cd req-214aebc9-2d74-49af-ba21-5210e703c8b1 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.035985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-3caa996a-a7e7-4bf9-99b7-e1563a8aa4cd req-214aebc9-2d74-49af-ba21-5210e703c8b1 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.036409 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-3caa996a-a7e7-4bf9-99b7-e1563a8aa4cd req-214aebc9-2d74-49af-ba21-5210e703c8b1 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.048132 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-3caa996a-a7e7-4bf9-99b7-e1563a8aa4cd req-214aebc9-2d74-49af-ba21-5210e703c8b1 service nova] Creating event network-vif-plugged:4a6bff08-0d49-4863-be8c-5097b81b1188 for instance 7bec501f-50e0-40ea-ba38-c2df09fd439b on hv-cinder-80152 Oct 14 03:12:55.053559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-3caa996a-a7e7-4bf9-99b7-e1563a8aa4cd req-214aebc9-2d74-49af-ba21-5210e703c8b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Oct 14 03:12:55.054183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 399/773] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:55.059726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-95b50daa-cc76-4f42-a2fb-9b329a92f7bf req-95f527d7-639d-4455-aa6f-6a8e289c9c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd7272a-6200-4e43-a875-486a9dfdf4de", "name": "network-vif-deleted", "tag": "fca8f750-40b5-480b-be0b-74873e93a6ba"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:12:55.070397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-95b50daa-cc76-4f42-a2fb-9b329a92f7bf req-95f527d7-639d-4455-aa6f-6a8e289c9c24 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.075183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-95b50daa-cc76-4f42-a2fb-9b329a92f7bf req-95f527d7-639d-4455-aa6f-6a8e289c9c24 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.075183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-95b50daa-cc76-4f42-a2fb-9b329a92f7bf req-95f527d7-639d-4455-aa6f-6a8e289c9c24 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.082285 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-95b50daa-cc76-4f42-a2fb-9b329a92f7bf req-95f527d7-639d-4455-aa6f-6a8e289c9c24 service nova] Creating event network-vif-deleted:fca8f750-40b5-480b-be0b-74873e93a6ba for instance ccd7272a-6200-4e43-a875-486a9dfdf4de on hv-cinder-80152 Oct 14 03:12:55.087164 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-95b50daa-cc76-4f42-a2fb-9b329a92f7bf req-95f527d7-639d-4455-aa6f-6a8e289c9c24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031372 Oct 14 03:12:55.087737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 400/774] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:12:55.348004 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2f8875d2-ec02-4656-a757-f97ada741d24 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "DELETE /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 204 len: 0 microversion: 2.1 time: 0.417437 Oct 14 03:12:55.349019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 375/775] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:12:54 2022] DELETE /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:12:55.359516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:55.361122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:55.369094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.370246 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.370913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.371859 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.372732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.373320 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.512713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:55.513167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:55.513431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:55.520612 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.528560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.528560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.528775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ab482cfe-cf46-4f20-90e4-bcea1c136ac2 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1689 microversion: 2.1 time: 0.167093 Oct 14 03:12:55.528879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.528879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.528879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.534334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 401/776] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:55 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:55.662625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:55.670607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0d30545a-aba1-4b24-a49a-131fd8c99ff2 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.163943 Oct 14 03:12:55.674996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 376/777] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:55 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:55.684931 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:55.685733 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:55.692477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.693546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.693546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.694309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.698578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.698578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.730538 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:55.731017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:55.731455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:55.731906 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid ccd7272a-6200-4e43-a875-486a9dfdf4de {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:55.771248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:55.779496 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7ebd48f1-4b7e-4466-883c-64f7286261c6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1332 microversion: 2.1 time: 0.098472 Oct 14 03:12:55.780065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 402/778] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:55 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:56.545597 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:56.546265 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:56.553428 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.553953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.554389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.555101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.555560 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.555983 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.679611 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:56.687250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-26844b30-d0c3-4fdc-8055-96c08b2144cb tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1689 microversion: 2.1 time: 0.145712 Oct 14 03:12:56.687915 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 377/779] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:56 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:56.695361 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:56.695966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:56.702280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.702754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.703181 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.703856 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.704332 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.704745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.802601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:56.803656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:56.809555 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.810068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.810502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.811183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.811654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.812076 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.816140 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:56.832005 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:56.839647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8d28b070-5eaf-4920-94c0-1c6fac5c66a4 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.148785 Oct 14 03:12:56.840214 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 403/780] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:56 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:56.843578 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:56.844054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:56.844480 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:56.844919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid ccd7272a-6200-4e43-a875-486a9dfdf4de {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:56.886406 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:56.894307 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e93049d3-a69e-4841-ad9d-1cc54e149d41 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1332 microversion: 2.1 time: 0.095589 Oct 14 03:12:56.894867 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 378/781] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:56 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:57.711333 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:57.711945 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:57.718123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.718608 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.719048 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.719737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.720204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.720624 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.845186 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:57.852805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0f5a8c7f-bd3e-422d-a975-88a3ee1ba76a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1689 microversion: 2.1 time: 0.145972 Oct 14 03:12:57.853363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 404/782] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:57 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:57.863733 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:57.864345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:57.871485 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.871963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.872396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.873079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.873528 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.873972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.916282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:57.916900 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:57.922752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.923232 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.923669 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.924356 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.924804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.925221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.956075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:57.956562 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:57.956998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:57.957450 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid ccd7272a-6200-4e43-a875-486a9dfdf4de {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:58.008106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:58.016169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-61ae557a-f01a-45ec-877a-06747b77921d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1332 microversion: 2.1 time: 0.103626 Oct 14 03:12:58.016741 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 405/783] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:57 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:12:58.029369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:58.037006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e0983538-38e1-45e7-8189-67b3cd54c23c tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.177770 Oct 14 03:12:58.037563 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 379/784] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:57 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:58.876279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:58.876890 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:58.883195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:58.883682 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:58.884108 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:58.884805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:58.885258 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:58.885678 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:59.017379 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:59.025815 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3d9bce3d-45a8-4af7-ad4e-c6ab42bfd078 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1689 microversion: 2.1 time: 0.153505 Oct 14 03:12:59.026430 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 406/785] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:58 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:59.039801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:59.045438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:59.053703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:59.054220 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:59.054993 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:59.056079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:59.056536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:59.057134 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:59.059577 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:12:59.060385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:12:59.066324 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:59.067043 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:59.067572 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:59.068217 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:59.068640 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:59.069062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:59.088879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:12:59.089363 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:12:59.089825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:12:59.090275 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid ccd7272a-6200-4e43-a875-486a9dfdf4de {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:12:59.158498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:59.166143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-81c17e71-76dc-4aef-9fee-97449dc5c9da tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1332 microversion: 2.1 time: 0.131020 Oct 14 03:12:59.166712 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 380/786] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:59 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:12:59.218533 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:12:59.226033 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-792c6bae-d6dd-4343-ad22-d5545ba961b9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.170308 Oct 14 03:12:59.226596 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 407/787] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:12:59 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:00.049356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:00.050006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:00.057396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.057925 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.058362 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.059088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.059516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.060151 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.188981 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:00.190576 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:00.198123 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:00.198299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.198670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.199099 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.200262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.200939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.201429 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.206795 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1ade1ea2-4791-4cce-ace8-1bdf07058c1a tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1689 microversion: 2.1 time: 0.161209 Oct 14 03:13:00.208381 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 381/788] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:00 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:00.233553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:00.239160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.239719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.241031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.241464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid ccd7272a-6200-4e43-a875-486a9dfdf4de {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:00.248692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:00.249302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:00.258674 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.259252 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.259757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.260530 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:00.261047 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:00.262130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:00.290069 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:00.299345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6aeb7ac9-95e0-4a6d-b944-921a7c4f1847 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 200 len: 1332 microversion: 2.1 time: 0.114418 Oct 14 03:13:00.300481 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 408/789] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:00 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:00.566331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:00.574446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a2cf8b57-8385-4657-b312-179fb88323ce tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1363 microversion: 2.1 time: 0.329758 Oct 14 03:13:00.575003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 382/790] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:00 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:01.065213 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-ce48337f-32b2-4ba3-b38b-cc850fd14d2c req-c312616a-2e46-4f5e-bc6c-60a9db70f551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07426fa3-a9d9-4304-854a-b6a298b3f8c7", "name": "network-vif-deleted", "tag": "04f7e24a-0bec-4456-bb1a-56489e3f78c6"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:01.074846 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-ce48337f-32b2-4ba3-b38b-cc850fd14d2c req-c312616a-2e46-4f5e-bc6c-60a9db70f551 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.075310 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-ce48337f-32b2-4ba3-b38b-cc850fd14d2c req-c312616a-2e46-4f5e-bc6c-60a9db70f551 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.075738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-ce48337f-32b2-4ba3-b38b-cc850fd14d2c req-c312616a-2e46-4f5e-bc6c-60a9db70f551 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.088071 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-ce48337f-32b2-4ba3-b38b-cc850fd14d2c req-c312616a-2e46-4f5e-bc6c-60a9db70f551 service nova] Creating event network-vif-deleted:04f7e24a-0bec-4456-bb1a-56489e3f78c6 for instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 on hv-cinder-80152 Oct 14 03:13:01.093259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-ce48337f-32b2-4ba3-b38b-cc850fd14d2c req-c312616a-2e46-4f5e-bc6c-60a9db70f551 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096761 Oct 14 03:13:01.098328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 409/791] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:01.231034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.231677 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:01.234109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:01.239956 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.240454 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.240894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.241603 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.242167 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.242521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.310944 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:01.319124 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-38f8cad3-d799-418c-90b7-091cd1aa2724 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1330 microversion: 2.1 time: 0.091932 Oct 14 03:13:01.319804 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 383/792] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:01 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1330 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:01.338820 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.339536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:01.346205 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.346684 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.347111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.347792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.348237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.348653 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.364536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de HTTP/1.1 Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:13:01.366183 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:13:01.367860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'ccd7272a-6200-4e43-a875-486a9dfdf4de'} Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:01.368697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:13:01.370180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:01.371445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:01.371445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f13b0afa-4c83-447e-8785-fbe41d2fe933 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 404 len: 111 microversion: 2.1 time: 0.048256 Oct 14 03:13:01.371445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 410/793] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:01 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:13:01.376740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-da74b4bd-ae96-4b81-b011-7751dc454ae0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '.version_select at 0x7f2beb760ca0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.457633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-da74b4bd-ae96-4b81-b011-7751dc454ae0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117831336" status: 202 len: 0 microversion: 2.1 time: 0.084650 Oct 14 03:13:01.458253 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 384/794] 10.222.0.39 () {58 vars in 1221 bytes} [Fri Oct 14 03:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117831336 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:13:01.597775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.598762 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:01.606449 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.609532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.609532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.609532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.609532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.610539 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.613248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:01.793491 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:01.803462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8d1f0051-fe43-4f75-ada2-0bc0618e273b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1549 microversion: 2.1 time: 0.208980 Oct 14 03:13:01.804023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 411/795] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:01 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1549 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:01.827395 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:01.827800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:01.834157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.834663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.835104 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.835792 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:01.836246 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:01.836689 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:01.916491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-db5466b8-7bfe-4f8c-91f3-b2ad13090bd9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093035 Oct 14 03:13:01.917074 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 385/796] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Oct 14 03:13:01 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:02.296683 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-19bcce2f-8621-48a7-b3a3-d8a60e3012bd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: .version_select at 0x7f2beb859430>, body: {"keypair": {"name": "tempest-keypair-1726210303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/dYInv3nDX03tteUju1rW5r0om4GweB36ILQaPkzrsMi6aAf7hs3rMDSYctXIfH+FFPU7Rn6/5H8PJKpY3/mEshdV6Dvel/uxNoHH6NnAPXoyx4x8nU9qNHAGePHGL0g=="}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:02.312778 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-19bcce2f-8621-48a7-b3a3-d8a60e3012bd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for project 20fb24be77624e59b8560c7863ca4a46. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:13:02.316691 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-19bcce2f-8621-48a7-b3a3-d8a60e3012bd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for user 410b7c9e93c94ce78d1b5c0e646307a2 and project 20fb24be77624e59b8560c7863ca4a46. Resources: {'key_pairs'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:13:02.346512 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:02.347233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:02.353690 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:02.356311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:02.356311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:02.356311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:02.356311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:02.356744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:02.388239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:02.388765 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:02.389133 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:02.389581 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lazy-loading 'fault' on Instance uuid 07426fa3-a9d9-4304-854a-b6a298b3f8c7 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:02.409516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-19bcce2f-8621-48a7-b3a3-d8a60e3012bd tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117372 Oct 14 03:13:02.410544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 412/797] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:13:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:02.460688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:02.468206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1f48ec6c-743d-4c6a-b87d-4d09816092cc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 200 len: 1335 microversion: 2.1 time: 0.126137 Oct 14 03:13:02.469678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 386/798] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:02 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:03.212609 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-06498e5d-526b-42b5-9886-805421c9e459 req-7c65d282-c5d8-4ab7-a963-68e0756cd84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bec501f-50e0-40ea-ba38-c2df09fd439b", "tag": "4a6bff08-0d49-4863-be8c-5097b81b1188"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:03.223199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-06498e5d-526b-42b5-9886-805421c9e459 req-7c65d282-c5d8-4ab7-a963-68e0756cd84d service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:03.223683 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-06498e5d-526b-42b5-9886-805421c9e459 req-7c65d282-c5d8-4ab7-a963-68e0756cd84d service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:03.224330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-06498e5d-526b-42b5-9886-805421c9e459 req-7c65d282-c5d8-4ab7-a963-68e0756cd84d service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:03.235544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-06498e5d-526b-42b5-9886-805421c9e459 req-7c65d282-c5d8-4ab7-a963-68e0756cd84d service nova] Creating event network-changed:4a6bff08-0d49-4863-be8c-5097b81b1188 for instance 7bec501f-50e0-40ea-ba38-c2df09fd439b on hv-cinder-80152 Oct 14 03:13:03.241099 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-06498e5d-526b-42b5-9886-805421c9e459 req-7c65d282-c5d8-4ab7-a963-68e0756cd84d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032570 Oct 14 03:13:03.241750 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 413/799] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:03.493188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:03.493882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 07426fa3-a9d9-4304-854a-b6a298b3f8c7] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:03.501212 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:03.501731 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:03.502563 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:03.502954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:03.503407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:03.503828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:03.518865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] HTTP exception thrown: Instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 could not be found. Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Request method failure captured: Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 HTTP/1.1 Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ-3La-kNpIaXxqS92x0RHqvXA16s4kGRVTPJOh9I4w33TN-8Kdm8KMswN-0sAhEnPB8F84xOWZd6MrRCKjPYbDU5wVTU3x-ea7nO92kSrT1cxdlWI2bwsOq6wbJoNZUr3bHwytcu5-fP6WVB8itTPTt4-KZM83SljPw5elkacbB5U Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:13:03.520813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_44d8a8798bc64aefadd52c30a21002ef"}]}] Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 could not be found. Oct 14 03:13:03.532250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '07426fa3-a9d9-4304-854a-b6a298b3f8c7'} Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 could not be found. Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:03.533281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 could not be found. Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 could not be found. Oct 14 03:13:03.534874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:03.536172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Returning 404 to user: Instance 07426fa3-a9d9-4304-854a-b6a298b3f8c7 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:03.536172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9d73176e-a5e8-41df-b703-7200650a6967 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7" status: 404 len: 111 microversion: 2.1 time: 0.033638 Oct 14 03:13:03.536172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 387/800] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:03 2022] GET /compute/v2.1/servers/07426fa3-a9d9-4304-854a-b6a298b3f8c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:03.536419 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f269366e-f9e7-41ca-836e-69c84caa208c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '.version_select at 0x7f2beb8c6ee0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:03.606092 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f269366e-f9e7-41ca-836e-69c84caa208c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436493738" status: 202 len: 0 microversion: 2.1 time: 0.078424 Oct 14 03:13:03.610943 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 414/801] 10.222.0.39 () {58 vars in 1218 bytes} [Fri Oct 14 03:13:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436493738 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:04.853379 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-100304284", "imageRef": "3bfdbba1-8a42-4757-b5e3-dd167ecc7a67", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb28930e-3d0a-43c7-985a-b1d6573d124d"}], "security_groups": [{"name": "tempest-securitygroup--231555941"}], "key_name": "tempest-keypair-1726210303", "user_data": "}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:04.954823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] validate_networks() for [('bb28930e-3d0a-43c7-985a-b1d6573d124d', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:13:05.368256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:13:05.369476 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:13:05.370029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:13:05.370445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:13:05.370851 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:13:05.379605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:05.380080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:05.382260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:05.382260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:05.382260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:05.382260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:05.398424 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for project 20fb24be77624e59b8560c7863ca4a46. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:13:05.402478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Getting quotas for user 410b7c9e93c94ce78d1b5c0e646307a2 and project 20fb24be77624e59b8560c7863ca4a46. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:13:05.413942 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:13:05.416221 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3bfdbba1-8a42-4757-b5e3-dd167ecc7a67',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:13:05.538926 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a57b458e-84fb-4d22-a9ee-aec4e63c79d0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689791 Oct 14 03:13:05.539576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 388/802] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:13:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:13:05.551495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7bd17afe-5463-4e1b-8ba0-f982704a64db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:05.556799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7bd17afe-5463-4e1b-8ba0-f982704a64db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:05.606784 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7bd17afe-5463-4e1b-8ba0-f982704a64db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:05.614027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7bd17afe-5463-4e1b-8ba0-f982704a64db tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1241 microversion: 2.1 time: 0.067037 Oct 14 03:13:05.614876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 415/803] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:05 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:06.637273 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:06.637964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:06.644921 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:06.645403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:06.645863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:06.646583 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:06.647037 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:06.647462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:06.710351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:06.718010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4700d56d-ef06-48b3-92a8-71bd4d71dbd0 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1245 microversion: 2.1 time: 0.085453 Oct 14 03:13:06.718633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 389/804] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:06 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:07.065024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:07.065650 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:07.072790 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.073272 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.073705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.074438 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.074940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.075311 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.100494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:13:07.366582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2f98355a-7f1c-4168-9d7b-c887b0ce8d10 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 204 len: 0 microversion: 2.1 time: 0.305016 Oct 14 03:13:07.367084 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 416/805] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:13:07 2022] DELETE /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:13:07.375053 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:07.375783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:07.381721 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.382717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.383147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.383821 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.384266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.384678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.512063 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:07.519738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-89c3c665-b7b8-4c5b-a858-5db2ec05e183 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1506 microversion: 2.1 time: 0.148443 Oct 14 03:13:07.520283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 390/806] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:07 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:07.741716 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:07.742440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:07.748326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.748922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.749353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.750075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:07.750523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:07.750936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:07.815305 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:07.823448 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c5b9da12-57bc-4d63-b1a3-6eef547c2b3e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1301 microversion: 2.1 time: 0.086426 Oct 14 03:13:07.824009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 417/807] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:07 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:08.544896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:08.545504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:08.551875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.552345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.552774 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.553450 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.553959 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.554379 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.679063 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:08.686665 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-271c1233-2637-4ce3-bb3c-2748de8b13fc tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1506 microversion: 2.1 time: 0.145616 Oct 14 03:13:08.687212 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 391/808] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:08 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:08.846025 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:08.846630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:08.853029 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.853505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.853972 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.854683 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:08.855133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:08.855547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:08.916219 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:08.923870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-452ba1c4-fc17-4437-b7f1-1533cfc1bf56 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1301 microversion: 2.1 time: 0.081701 Oct 14 03:13:08.924461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 418/809] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:08 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:09.709630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:09.710308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:09.716743 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:09.717215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:09.717647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:09.724345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:09.724345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:09.724345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:09.851441 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:09.859095 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6ecbe7bc-1d40-455a-9d26-394e25e98a0b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1506 microversion: 2.1 time: 0.153366 Oct 14 03:13:09.859646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 392/810] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:09 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:09.946622 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:09.947205 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:09.953996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:09.954395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:09.954831 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:09.955718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:09.956166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:09.956594 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:10.023601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:10.031399 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-521bf531-22e6-4573-b1f2-37a26278b33f tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1311 microversion: 2.1 time: 0.088948 Oct 14 03:13:10.031971 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 419/811] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:09 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:10.889147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:10.889861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:10.901426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:10.903543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:10.903695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:10.905299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:10.905789 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:10.906263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:10.964933 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-8446ad3f-0193-4183-92fc-db391e4115dd req-aab6f698-2b83-44ea-8885-98834c34b77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2de16b-159b-4d0a-8830-7c37d2c16d63", "name": "network-vif-deleted", "tag": "85b7ee5a-21b7-45b0-9d95-c8b510e07a5f"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:10.987481 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8446ad3f-0193-4183-92fc-db391e4115dd req-aab6f698-2b83-44ea-8885-98834c34b77a service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:10.988731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8446ad3f-0193-4183-92fc-db391e4115dd req-aab6f698-2b83-44ea-8885-98834c34b77a service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:10.988731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8446ad3f-0193-4183-92fc-db391e4115dd req-aab6f698-2b83-44ea-8885-98834c34b77a service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.017703 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-8446ad3f-0193-4183-92fc-db391e4115dd req-aab6f698-2b83-44ea-8885-98834c34b77a service nova] Creating event network-vif-deleted:85b7ee5a-21b7-45b0-9d95-c8b510e07a5f for instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 on hv-cinder-80152 Oct 14 03:13:11.019109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:11.022985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-8446ad3f-0193-4183-92fc-db391e4115dd req-aab6f698-2b83-44ea-8885-98834c34b77a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061532 Oct 14 03:13:11.024085 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 420/812] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:11.029413 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4680cc91-0029-4368-ae8e-790296bf3e6c tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1464 microversion: 2.1 time: 0.145996 Oct 14 03:13:11.030153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 393/813] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:10 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:11.056179 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:11.057162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:11.064465 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.064950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.069920 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.069920 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.069920 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.069920 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.260589 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:11.269673 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-70fa0426-eb4d-47e3-a75e-a22f83d927d7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.218372 Oct 14 03:13:11.270682 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 421/814] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:11 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:11.343423 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:11.343920 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:11.350163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.351153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.351789 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.352669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:11.353438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:11.353890 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:11.379150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2a000cb1-7914-49e6-a05a-d11126e1f799 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/ips" status: 200 len: 153 microversion: 2.20 time: 0.185148 Oct 14 03:13:11.379621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 394/815] 10.222.0.39 () {60 vars in 1289 bytes} [Fri Oct 14 03:13:11 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/ips => generated 153 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:13:12.052476 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:12.053093 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:12.059755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.060226 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.060655 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.061470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.062002 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.062421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.094617 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.095348 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.095987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.096434 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lazy-loading 'fault' on Instance uuid 8e2de16b-159b-4d0a-8830-7c37d2c16d63 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:12.141246 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:12.149721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-db67fe75-a9cf-4dad-9384-413637314faa tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 200 len: 1311 microversion: 2.1 time: 0.101077 Oct 14 03:13:12.150252 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 422/816] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:12 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:12.293168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:12.293747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:12.300042 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.300525 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.300959 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.301655 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:12.302149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:12.302577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:12.431313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:12.438832 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6ab0a27b-3558-4f2e-8b8e-482d7d7fe868 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.149495 Oct 14 03:13:12.439620 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 395/817] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:12 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:13.039202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-906a21b9-865c-4662-bc36-b3f057f3a13e req-49c1248e-13ec-4385-95b1-a55b16feb193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeae0791-4023-4ebe-8511-b09237e0425c", "tag": "381a3fc7-a66c-4541-80f1-f293b8f7523d"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:13.048435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-906a21b9-865c-4662-bc36-b3f057f3a13e req-49c1248e-13ec-4385-95b1-a55b16feb193 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.048906 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-906a21b9-865c-4662-bc36-b3f057f3a13e req-49c1248e-13ec-4385-95b1-a55b16feb193 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.049329 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-906a21b9-865c-4662-bc36-b3f057f3a13e req-49c1248e-13ec-4385-95b1-a55b16feb193 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.060171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-906a21b9-865c-4662-bc36-b3f057f3a13e req-49c1248e-13ec-4385-95b1-a55b16feb193 service nova] Creating event network-changed:381a3fc7-a66c-4541-80f1-f293b8f7523d for instance eeae0791-4023-4ebe-8511-b09237e0425c on hv-cinder-80152 Oct 14 03:13:13.064891 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-906a21b9-865c-4662-bc36-b3f057f3a13e req-49c1248e-13ec-4385-95b1-a55b16feb193 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030022 Oct 14 03:13:13.065482 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 423/818] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:13.172112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:13.172754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 8e2de16b-159b-4d0a-8830-7c37d2c16d63] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:13.178629 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.179106 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.179532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.180227 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.180653 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.181071 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.193995 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] HTTP exception thrown: Instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 could not be found. Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Request method failure captured: Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 HTTP/1.1 Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ-3La-kNpIaXxqS92x0RHqvXA16s4kGRVTPJOh9I4w33TN-8Kdm8KMswN-0sAhEnPB8F84xOWZd6MrRCKjPYbDU5wVTU3x-ea7nO92kSrT1cxdlWI2bwsOq6wbJoNZUr3bHwytcu5-fP6WVB8itTPTt4-KZM83SljPw5elkacbB5U Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:13:13.195481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_44d8a8798bc64aefadd52c30a21002ef"}]}] Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 could not be found. Oct 14 03:13:13.197044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '8e2de16b-159b-4d0a-8830-7c37d2c16d63'} Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 could not be found. Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:13.198274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 could not be found. Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 could not be found. Oct 14 03:13:13.199757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:13.201263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Returning 404 to user: Instance 8e2de16b-159b-4d0a-8830-7c37d2c16d63 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:13.201263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f6903b3f-ae39-48b2-a1d2-1810d24ce11b tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63" status: 404 len: 111 microversion: 2.1 time: 0.028758 Oct 14 03:13:13.201263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 396/819] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:13 2022] GET /compute/v2.1/servers/8e2de16b-159b-4d0a-8830-7c37d2c16d63 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:13.205699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:13.206241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:13.212726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.213203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.213634 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.214348 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.214796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.215214 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.240171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:13:13.462783 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:13.463305 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:13.469600 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.470106 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.470531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.471209 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.471654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.472068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.486952 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=100 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:13.498472 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b00eafa5-11de-41a2-bb93-5106cf5154bd tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "DELETE /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 204 len: 0 microversion: 2.1 time: 0.296596 Oct 14 03:13:13.499058 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 424/820] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:13:13 2022] DELETE /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 03:13:13.507938 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:13.508629 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:13.514548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.515039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.515475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.516175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:13.516631 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:13.517115 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:13.652897 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:13.660613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8b123fa2-8f65-477e-be22-600b48876f6c tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.202488 Oct 14 03:13:13.661166 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 397/821] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:13 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:13.680501 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:13.688009 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5be591a1-b840-478b-ad0f-e2e109446a8f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.184607 Oct 14 03:13:13.688568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 425/822] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:13 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:14.121518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:14.122191 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:14.128080 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.128557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.128990 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.129674 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.130159 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.130610 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.152707 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lazy-loading 'flavor' on Instance uuid c372d0ca-25ac-43bd-b519-1700473cb118 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:14.593513 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-393500b9-006b-464d-8b78-f93f7e12a639 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/action" status: 202 len: 0 microversion: 2.20 time: 0.475673 Oct 14 03:13:14.594491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 398/823] 10.222.0.39 () {62 vars in 1319 bytes} [Fri Oct 14 03:13:14 2022] POST /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:13:14.602815 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:14.603421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:14.609847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.610329 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.611024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.611708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.612160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.612578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.684079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:14.684698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:14.691735 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.692212 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.692673 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.693362 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.693841 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.694259 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.771319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:14.780019 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:14.781711 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:14.782912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bad1bddd-a944-47ac-8bcf-17e7f27b058c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.184525 Oct 14 03:13:14.783708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 426/824] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:14 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:14.788546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:14.789273 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:14.798493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.798493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.798493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.798493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:14.798894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:14.798894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:14.849475 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:14.857173 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a516c844-e748-4a4b-b3c8-aecacd81dca8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.177371 Oct 14 03:13:14.857723 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 399/825] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:14 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:14.930798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:14.938384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-16413c77-89b9-4d50-aa56-4174ff9e5176 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.153307 Oct 14 03:13:14.938881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 427/826] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:14 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:15.810268 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:15.810879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:15.812808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:15.813476 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:15.818667 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:15.819192 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:15.819574 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:15.821798 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:15.821798 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:15.821798 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:15.879847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:15.880452 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:15.882903 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=6 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:15.887675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:15.888155 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:15.890573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:15.890573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:15.890573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:15.890573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:15.992810 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:16.001121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:16.002624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:16.003812 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bbb124c8-3f7c-4c0d-bfb1-ceb17ff32f89 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.197469 Oct 14 03:13:16.013934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 400/827] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:15 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:16.013934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:16.013934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:16.018063 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:16.018627 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:16.019156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:16.019925 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:16.020497 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:16.020985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:16.042788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:16.050354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e6d1f084-ca65-466a-9bfa-9abd56086c5b tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.174687 Oct 14 03:13:16.050919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 428/828] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:15 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:16.148424 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:16.156629 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1645ac95-7c73-462a-ac9c-123c2da1d44f tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.151321 Oct 14 03:13:16.157184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 401/829] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:16 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:17.028765 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:17.029456 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:17.036826 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:17.037388 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:17.038034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:17.038824 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:17.039838 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:17.040264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:17.044342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:17.072745 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:17.073356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:17.082218 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:17.082771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:17.083204 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:17.083901 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:17.084375 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:17.084795 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:17.220306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:17.229581 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:17.231134 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:17.232381 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-22789e97-6906-4cc2-aff2-925f9bf84afa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.207630 Oct 14 03:13:17.239499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 429/830] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:17 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:17.239499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:17.239499 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:17.245159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:17.245647 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:17.246334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:17.247196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:17.247774 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:17.248292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:17.266900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:17.275190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2f86fcf6-981d-4f0a-af3f-47bdebfb9a2d tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.206394 Oct 14 03:13:17.276147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 402/831] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:17 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:17.388705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:17.396982 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d4317b9e-a92a-4905-987a-03e53c18b059 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1522 microversion: 2.1 time: 0.162977 Oct 14 03:13:17.397877 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 430/832] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:17 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:17.575549 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-dc70b6e2-d673-4a01-9b90-e90d362c5437 req-ab3e0009-d961-4509-9178-7fbb2a127600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d96e4d-ef17-461e-a4f4-ee55452c0223", "name": "network-vif-deleted", "tag": "8c75b196-f33a-4b89-b5fd-abf20f10fb84"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:17.584813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-dc70b6e2-d673-4a01-9b90-e90d362c5437 req-ab3e0009-d961-4509-9178-7fbb2a127600 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:17.586773 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-dc70b6e2-d673-4a01-9b90-e90d362c5437 req-ab3e0009-d961-4509-9178-7fbb2a127600 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:17.586773 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-dc70b6e2-d673-4a01-9b90-e90d362c5437 req-ab3e0009-d961-4509-9178-7fbb2a127600 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:17.596742 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-dc70b6e2-d673-4a01-9b90-e90d362c5437 req-ab3e0009-d961-4509-9178-7fbb2a127600 service nova] Creating event network-vif-deleted:8c75b196-f33a-4b89-b5fd-abf20f10fb84 for instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 on hv-cinder-80152 Oct 14 03:13:17.601472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-dc70b6e2-d673-4a01-9b90-e90d362c5437 req-ab3e0009-d961-4509-9178-7fbb2a127600 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029562 Oct 14 03:13:17.602756 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 403/833] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:18.264055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:18.264661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:18.271340 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.271819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.272251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.272940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.273395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.273869 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.299168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:18.299863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:18.306463 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.306941 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.307374 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.308049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.308493 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.308911 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.451645 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:18.460109 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:18.461590 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:18.462788 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-57cabde9-86fe-4111-9a62-9a6c482f0a18 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.202810 Oct 14 03:13:18.463342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 431/834] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:18 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:18.467689 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:18.468401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:18.475088 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.476388 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.478858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:18.482332 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.483156 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.483761 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.484421 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.487077 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cf1b94a8-2d66-4143-bde9-e95e0fd64fb6 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.192559 Oct 14 03:13:18.487986 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 404/835] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:18 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:18.517792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:18.518280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:18.518711 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:18.519155 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lazy-loading 'fault' on Instance uuid 96d96e4d-ef17-461e-a4f4-ee55452c0223 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:13:18.559571 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a4ea9e3987e4f0b9ad9ebe6d3c69b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44d8a8798bc64aefadd52c30a21002ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:18.567220 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b3f9b45e-ff78-4020-9f67-38bac443a4e3 tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 200 len: 1312 microversion: 2.1 time: 0.102933 Oct 14 03:13:18.567792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 432/836] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:18 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:18.997797 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-ea9eed0f-01cd-409c-9cb4-ee038d556372 req-1b030c70-cf81-49e7-a117-030dd8918f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeae0791-4023-4ebe-8511-b09237e0425c", "name": "network-vif-plugged", "status": "completed", "tag": "381a3fc7-a66c-4541-80f1-f293b8f7523d"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:19.012324 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-ea9eed0f-01cd-409c-9cb4-ee038d556372 req-1b030c70-cf81-49e7-a117-030dd8918f69 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.012799 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-ea9eed0f-01cd-409c-9cb4-ee038d556372 req-1b030c70-cf81-49e7-a117-030dd8918f69 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.013223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-ea9eed0f-01cd-409c-9cb4-ee038d556372 req-1b030c70-cf81-49e7-a117-030dd8918f69 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.024712 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-ea9eed0f-01cd-409c-9cb4-ee038d556372 req-1b030c70-cf81-49e7-a117-030dd8918f69 service nova] Creating event network-vif-plugged:381a3fc7-a66c-4541-80f1-f293b8f7523d for instance eeae0791-4023-4ebe-8511-b09237e0425c on hv-cinder-80152 Oct 14 03:13:19.029433 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-ea9eed0f-01cd-409c-9cb4-ee038d556372 req-1b030c70-cf81-49e7-a117-030dd8918f69 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087842 Oct 14 03:13:19.030202 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 405/837] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:19.488676 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:19.489274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:19.495746 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.496317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.496725 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.497404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.497876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.498297 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.511764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:19.512472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:19.518578 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.522236 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.522236 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.522236 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.522236 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.522619 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.690486 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:19.699251 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:19.700786 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:19.701995 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-dee49bc2-2f15-46fd-9fd7-a96106b27697 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.217444 Oct 14 03:13:19.702113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:19.702544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 433/838] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:19 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:19.707204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:19.707799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] [instance: 96d96e4d-ef17-461e-a4f4-ee55452c0223] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:19.714615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.715095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.715522 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.716386 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:19.716837 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:19.717801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:19.722091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7fa55e6d-ea86-438b-a69e-cc7c22dbb898 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.215374 Oct 14 03:13:19.722669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 406/839] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:19 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:19.730336 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] HTTP exception thrown: Instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 could not be found. Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Request method failure captured: Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 HTTP/1.1 Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ-3La-kNpIaXxqS92x0RHqvXA16s4kGRVTPJOh9I4w33TN-8Kdm8KMswN-0sAhEnPB8F84xOWZd6MrRCKjPYbDU5wVTU3x-ea7nO92kSrT1cxdlWI2bwsOq6wbJoNZUr3bHwytcu5-fP6WVB8itTPTt4-KZM83SljPw5elkacbB5U Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:13:19.732017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/44d8a8798bc64aefadd52c30a21002ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_44d8a8798bc64aefadd52c30a21002ef"}]}] Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 44d8a8798bc64aefadd52c30a21002ef Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-453558876 Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 7a4ea9e3987e4f0b9ad9ebe6d3c69b7b Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-ServerRescueNegativeTestJSON-453558876-project Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 could not be found. Oct 14 03:13:19.733520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': '96d96e4d-ef17-461e-a4f4-ee55452c0223'} Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 could not be found. Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:19.734318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 could not be found. Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 could not be found. Oct 14 03:13:19.735759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:19.736829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] Returning 404 to user: Instance 96d96e4d-ef17-461e-a4f4-ee55452c0223 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:19.736829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6f332fcb-6803-4606-b6ee-58a6995d9e8d tempest-ServerRescueNegativeTestJSON-453558876 tempest-ServerRescueNegativeTestJSON-453558876-project] 10.222.0.39 "GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223" status: 404 len: 111 microversion: 2.1 time: 0.029731 Oct 14 03:13:19.736829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 434/840] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:19 2022] GET /compute/v2.1/servers/96d96e4d-ef17-461e-a4f4-ee55452c0223 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:20.727913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:20.728454 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:20.735343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:20.736216 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:20.736661 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:20.737370 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:20.737853 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:20.738310 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:20.747947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:20.749781 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:20.755579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:20.756207 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:20.756743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:20.757542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:20.758223 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:20.758681 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:20.998579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:21.001567 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:21.006825 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-740d2e05-2698-4f7e-a724-ffcf29039fd2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1366 microversion: 2.1 time: 0.264131 Oct 14 03:13:21.020122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 435/841] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:20 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:13:21.026896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:21.028462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:21.029669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a44de9d4-3045-45ec-939c-a443d3758ce4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.306356 Oct 14 03:13:21.030450 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 407/842] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:20 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:22.030067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:22.030682 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:22.041866 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:22.042345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:22.042783 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:22.043488 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:22.043940 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:22.044392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:22.057720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:22.058537 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:22.073435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:22.073965 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:22.074407 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:22.076246 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:22.076908 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:22.077538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:22.311520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:22.319347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2b21ecef-639d-402b-8b08-f1503e2f1f76 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1556 microversion: 2.1 time: 0.293059 Oct 14 03:13:22.319887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 436/843] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:13:22 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1556 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:22.326794 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:22.335405 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:22.337520 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:22.338750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-318a11cf-28f2-4584-8f25-7af53965b41f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.285057 Oct 14 03:13:22.339304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 408/844] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:22 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:22.342553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:22.343080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:22.348952 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:22.349430 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:22.349887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:22.350585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:22.351035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:22.351457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:22.474930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cb93e576-6405-4e8a-8d25-d05c47a7adc2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133635 Oct 14 03:13:22.474930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 437/845] 10.222.0.39 () {58 vars in 1275 bytes} [Fri Oct 14 03:13:22 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:23.366036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:23.366525 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:23.374983 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:23.375708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:23.376318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:23.377211 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:23.377858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:23.378445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:23.508153 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-299b421d-02d4-4ded-a575-fbb0b810f2f8 req-e1c917ad-ff38-4ddc-9b0a-1028674830ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeae0791-4023-4ebe-8511-b09237e0425c", "tag": "381a3fc7-a66c-4541-80f1-f293b8f7523d"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:23.518034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-299b421d-02d4-4ded-a575-fbb0b810f2f8 req-e1c917ad-ff38-4ddc-9b0a-1028674830ad service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:23.519551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-299b421d-02d4-4ded-a575-fbb0b810f2f8 req-e1c917ad-ff38-4ddc-9b0a-1028674830ad service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:23.519551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-299b421d-02d4-4ded-a575-fbb0b810f2f8 req-e1c917ad-ff38-4ddc-9b0a-1028674830ad service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:23.531910 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:23.533003 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-299b421d-02d4-4ded-a575-fbb0b810f2f8 req-e1c917ad-ff38-4ddc-9b0a-1028674830ad service nova] Creating event network-changed:381a3fc7-a66c-4541-80f1-f293b8f7523d for instance eeae0791-4023-4ebe-8511-b09237e0425c on hv-cinder-80152 Oct 14 03:13:23.538475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-299b421d-02d4-4ded-a575-fbb0b810f2f8 req-e1c917ad-ff38-4ddc-9b0a-1028674830ad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034687 Oct 14 03:13:23.540231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 438/846] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:23.544306 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:23.545950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:23.547478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fd842321-f961-4de6-b1bc-9544fb21c76a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.185532 Oct 14 03:13:23.550178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 409/847] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:23 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:24.575854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:24.576548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:24.583013 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:24.583497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:24.583928 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:24.584619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:24.585070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:24.585487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:24.723370 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:24.735104 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:24.737200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:24.738573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7fedc7f7-b914-4c3d-b7a5-76f267c83cdb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.168130 Oct 14 03:13:24.739137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 439/848] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:24 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:25.647764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0ec88c6d-7382-4d12-9311-f262f7f57c29 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Action: 'create', calling method: .version_select at 0x7f2beb842f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1159261084"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:25.764640 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:25.765240 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:25.771623 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:25.772111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:25.772546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:25.773242 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:25.773692 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:25.774147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:25.900299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:25.908331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:25.909776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:25.910913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5f951f71-75b0-42d9-a72d-a08697a20cae tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.150147 Oct 14 03:13:25.911459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 440/849] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:25 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:26.244398 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0ec88c6d-7382-4d12-9311-f262f7f57c29 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.706442 Oct 14 03:13:26.245030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 410/850] 10.222.0.39 () {60 vars in 1155 bytes} [Fri Oct 14 03:13:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 708 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 14 03:13:26.257552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-885141e8-33ae-40bb-8e6b-f7d47dc71bf5 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb9a8550>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:26.304363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-885141e8-33ae-40bb-8e6b-f7d47dc71bf5 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9" status: 200 len: 345 microversion: 2.1 time: 0.050480 Oct 14 03:13:26.305616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 441/851] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:26 2022] GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:26.944328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:26.944932 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:26.952213 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:26.952741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:26.953172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:26.953882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:26.954333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:26.954750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:27.084014 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:27.092636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:27.095050 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:27.095308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9ef935bd-2fbd-4f52-a14f-a4011c224fa3 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.155345 Oct 14 03:13:27.095811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 411/852] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:26 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:27.319748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8c3acee9-4bae-46a9-9865-2d24f4cca42b tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb8c2ca0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:27.367738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8c3acee9-4bae-46a9-9865-2d24f4cca42b tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9" status: 200 len: 346 microversion: 2.1 time: 0.051826 Oct 14 03:13:27.368296 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 442/853] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:27 2022] GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:27.381170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a1a87496-3172-4ff5-b839-d82aa96ac774 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Action: 'create', calling method: .version_select at 0x7f2beb8dac10>, body: {"snapshot": {"volume_id": "c1de6858-49b0-499f-b3b7-7325ce456ab9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1360442813"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:27.812191 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a1a87496-3172-4ff5-b839-d82aa96ac774 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.434731 Oct 14 03:13:27.812765 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 412/854] 10.222.0.39 () {60 vars in 1162 bytes} [Fri Oct 14 03:13:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:27.824143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-50f6acb7-2e3f-4be6-8abc-07629ba3fca9 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb84d4c0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:27.856075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-50f6acb7-2e3f-4be6-8abc-07629ba3fca9 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a" status: 200 len: 287 microversion: 2.1 time: 0.035741 Oct 14 03:13:27.856636 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 443/855] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Oct 14 03:13:27 2022] GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:27.868411 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5b0244bc-f253-4e04-9c02-7222a6b0b40a tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb8b4790>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:27.898535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5b0244bc-f253-4e04-9c02-7222a6b0b40a tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034463 Oct 14 03:13:27.899096 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 413/856] 10.222.0.39 () {58 vars in 1140 bytes} [Fri Oct 14 03:13:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:27.910123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-51efc6e6-2fd4-496b-aa5e-b5d3848598e9 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb8c20d0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:27.939485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-51efc6e6-2fd4-496b-aa5e-b5d3848598e9 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a" status: 200 len: 287 microversion: 2.1 time: 0.033028 Oct 14 03:13:27.940039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 444/857] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Oct 14 03:13:27 2022] GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:28.121705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:28.122328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:28.128268 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:28.128686 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:28.129111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:28.129832 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:28.130282 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:28.130700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:28.259960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:28.268000 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:28.269411 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:28.270595 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-58229112-7a87-44f0-a1b1-2f798ee80e55 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.154076 Oct 14 03:13:28.271138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 414/858] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:28 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:28.952783 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3b75a06c-b4a1-4889-b8e7-7ae7897877ea tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb8eeb80>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:28.981407 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3b75a06c-b4a1-4889-b8e7-7ae7897877ea tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a" status: 200 len: 287 microversion: 2.1 time: 0.032886 Oct 14 03:13:28.981985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 445/859] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Oct 14 03:13:28 2022] GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:29.296226 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:29.296791 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:29.303252 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:29.303735 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:29.304166 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:29.305488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:29.305976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:29.306396 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:29.430576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:29.438432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:29.439863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:29.441023 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-11fcbb57-82d7-407e-a696-97816ff7bd88 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.148792 Oct 14 03:13:29.441590 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 415/860] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:29 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:29.994972 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9fddc07c-5cb6-4a99-9e29-62d21147d3e4 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb839820>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:30.025798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9fddc07c-5cb6-4a99-9e29-62d21147d3e4 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a" status: 200 len: 287 microversion: 2.1 time: 0.035089 Oct 14 03:13:30.026378 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 446/861] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Oct 14 03:13:29 2022] GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:30.465836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:30.466391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:30.472782 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:30.473266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:30.473701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:30.474421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:30.474879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:30.475300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:30.490203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:30.605313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:30.613403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:30.615487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:30.616658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c3418557-3588-430e-aba6-5a9e25ea4437 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.154822 Oct 14 03:13:30.617875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 416/862] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:30 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:31.038053 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-380fdfff-c9ab-4757-b498-b6e3dd0660e5 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb86e550>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:31.068129 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-380fdfff-c9ab-4757-b498-b6e3dd0660e5 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a" status: 200 len: 288 microversion: 2.1 time: 0.034292 Oct 14 03:13:31.068686 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 447/863] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Oct 14 03:13:31 2022] GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:31.079777 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9bded872-32b2-4683-b758-fdace9b4f42f tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb73c310>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:31.216594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9bded872-32b2-4683-b758-fdace9b4f42f tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a" status: 202 len: 0 microversion: 2.1 time: 0.140552 Oct 14 03:13:31.217168 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 417/864] 10.222.0.39 () {58 vars in 1254 bytes} [Fri Oct 14 03:13:31 2022] DELETE /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:31.225194 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a2d501fb-b05c-48db-ab67-c0bd630e7294 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb86e160>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:31.258278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a2d501fb-b05c-48db-ab67-c0bd630e7294 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a" status: 200 len: 287 microversion: 2.1 time: 0.036674 Oct 14 03:13:31.258843 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 448/865] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Oct 14 03:13:31 2022] GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:31.648992 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:31.649602 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:31.651495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:31.656165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:31.657425 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:31.658057 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:31.658750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:31.659198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:31.659612 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:31.786202 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:31.794294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:31.795712 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:31.796896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-62c5c705-5247-4c08-963e-adc8de095757 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.152914 Oct 14 03:13:31.797441 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 418/866] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:31 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:32.271638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-de1b0472-5d2b-47f4-b5f5-b0e3498c7abd tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb875dc0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:32.295879 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-de1b0472-5d2b-47f4-b5f5-b0e3498c7abd tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] HTTP exception thrown: Snapshot a7dbaafd-b28c-4597-807e-7af6c648a39a could not be found. Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-de1b0472-5d2b-47f4-b5f5-b0e3498c7abd tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Request method failure captured: Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a HTTP/1.1 Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNPVLhE8Mfi-P9rhJYyGrqvKFUApT1rOLWIL2aB_uxL-Ns7hI7yqrwaSw-4zgaUYBZK6_LmpDZg4qwmt3SFPs2VAHpLL30OX-GfZMzYi21FwRO5133H7gtC6m5WaGoVlu6iWWhQadMA_ltSCjmQTWORjhFGSskFC9k_V_WqiYpfIci4 Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 9b612d10ff3b402ea7571f3134c88a11 Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:13:32.298167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b612d10ff3b402ea7571f3134c88a11"}]}] Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 9b612d10ff3b402ea7571f3134c88a11 Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-VolumesSnapshotsTestJSON-1809056818-project Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 30901704e6a7408cb7fdb8d5479dfd8a Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1809056818-project Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Snapshot a7dbaafd-b28c-4597-807e-7af6c648a39a could not be found. Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'a7dbaafd-b28c-4597-807e-7af6c648a39a'} Oct 14 03:13:32.299870 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a7dbaafd-b28c-4597-807e-7af6c648a39a could not be found. (HTTP 404) (Request-ID: req-5dea480b-8399-42d6-acb7-bf7335fae2ab) Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:32.301062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:32.302478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a7dbaafd-b28c-4597-807e-7af6c648a39a could not be found. Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 14 03:13:32.303908 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a7dbaafd-b28c-4597-807e-7af6c648a39a could not be found. Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a7dbaafd-b28c-4597-807e-7af6c648a39a could not be found. Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-de1b0472-5d2b-47f4-b5f5-b0e3498c7abd tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Returning 404 to user: Snapshot a7dbaafd-b28c-4597-807e-7af6c648a39a could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:32.306078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-de1b0472-5d2b-47f4-b5f5-b0e3498c7abd tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a" status: 404 len: 111 microversion: 2.1 time: 0.032337 Oct 14 03:13:32.307050 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 449/867] 10.222.0.39 () {58 vars in 1251 bytes} [Fri Oct 14 03:13:32 2022] GET /compute/v2.1/os-snapshots/a7dbaafd-b28c-4597-807e-7af6c648a39a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:32.308673 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9832b917-9fb8-48d6-9674-1bc28a39a693 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb8ec9d0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:32.495438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9832b917-9fb8-48d6-9674-1bc28a39a693 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9" status: 202 len: 0 microversion: 2.1 time: 0.190922 Oct 14 03:13:32.496005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 419/868] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:13:32 2022] DELETE /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:32.504631 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-171b8457-c358-4f0e-86d7-0f80edfb9e4d tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb94f8b0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:32.553634 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-171b8457-c358-4f0e-86d7-0f80edfb9e4d tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9" status: 200 len: 345 microversion: 2.1 time: 0.050999 Oct 14 03:13:32.553634 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 450/869] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:32 2022] GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:32.824148 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:32.824782 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:32.830822 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.833003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.833003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.833003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:32.833003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:32.833368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:32.964443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:32.972779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:32.974227 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:32.975443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ca1cd7c9-5c2d-47c0-8896-6444359748c4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.156265 Oct 14 03:13:32.976019 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 420/870] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:32 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:33.566889 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2819f362-ae74-45b8-a1a0-bd51cba91f0a tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb859e50>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:33.593415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-2819f362-ae74-45b8-a1a0-bd51cba91f0a tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] HTTP exception thrown: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2819f362-ae74-45b8-a1a0-bd51cba91f0a tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Request method failure captured: Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 HTTP/1.1 Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNPVLhE8Mfi-P9rhJYyGrqvKFUApT1rOLWIL2aB_uxL-Ns7hI7yqrwaSw-4zgaUYBZK6_LmpDZg4qwmt3SFPs2VAHpLL30OX-GfZMzYi21FwRO5133H7gtC6m5WaGoVlu6iWWhQadMA_ltSCjmQTWORjhFGSskFC9k_V_WqiYpfIci4 Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 9b612d10ff3b402ea7571f3134c88a11 Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:13:33.595437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b612d10ff3b402ea7571f3134c88a11"}]}] Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 9b612d10ff3b402ea7571f3134c88a11 Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-VolumesSnapshotsTestJSON-1809056818-project Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 30901704e6a7408cb7fdb8d5479dfd8a Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1809056818-project Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'c1de6858-49b0-499f-b3b7-7325ce456ab9'} Oct 14 03:13:33.597014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. (HTTP 404) (Request-ID: req-824bd983-0b7a-4f56-833d-0632fc274e1c) Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.597960 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:33.599325 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 03:13:33.600706 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2819f362-ae74-45b8-a1a0-bd51cba91f0a tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Returning 404 to user: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2819f362-ae74-45b8-a1a0-bd51cba91f0a tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9" status: 404 len: 109 microversion: 2.1 time: 0.034482 Oct 14 03:13:33.602642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 451/871] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:33 2022] GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:33.607436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a5a4c0ef-2c2a-400c-99f6-dcb62ef6be12 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb73c550>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:33.635470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-a5a4c0ef-2c2a-400c-99f6-dcb62ef6be12 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] HTTP exception thrown: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a5a4c0ef-2c2a-400c-99f6-dcb62ef6be12 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Request method failure captured: Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: DELETE /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 HTTP/1.1 Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNPVLhE8Mfi-P9rhJYyGrqvKFUApT1rOLWIL2aB_uxL-Ns7hI7yqrwaSw-4zgaUYBZK6_LmpDZg4qwmt3SFPs2VAHpLL30OX-GfZMzYi21FwRO5133H7gtC6m5WaGoVlu6iWWhQadMA_ltSCjmQTWORjhFGSskFC9k_V_WqiYpfIci4 Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 9b612d10ff3b402ea7571f3134c88a11 Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:13:33.637700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b612d10ff3b402ea7571f3134c88a11"}]}] Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 9b612d10ff3b402ea7571f3134c88a11 Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-VolumesSnapshotsTestJSON-1809056818-project Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 30901704e6a7408cb7fdb8d5479dfd8a Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1809056818-project Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'c1de6858-49b0-499f-b3b7-7325ce456ab9'} Oct 14 03:13:33.639254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. (HTTP 404) (Request-ID: req-1c58880e-7949-4ff8-a621-b767760d4f3b) Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.640072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 03:13:33.641378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 03:13:33.642705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a5a4c0ef-2c2a-400c-99f6-dcb62ef6be12 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Returning 404 to user: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a5a4c0ef-2c2a-400c-99f6-dcb62ef6be12 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9" status: 404 len: 109 microversion: 2.1 time: 0.035325 Oct 14 03:13:33.644005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 421/872] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:13:33 2022] DELETE /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:33.647551 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dd47f108-2a18-4f34-810d-4776bf435de1 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Calling method '.version_select at 0x7f2beb859280>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:33.676060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-dd47f108-2a18-4f34-810d-4776bf435de1 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] HTTP exception thrown: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dd47f108-2a18-4f34-810d-4776bf435de1 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Request method failure captured: Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 HTTP/1.1 Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNPVLhE8Mfi-P9rhJYyGrqvKFUApT1rOLWIL2aB_uxL-Ns7hI7yqrwaSw-4zgaUYBZK6_LmpDZg4qwmt3SFPs2VAHpLL30OX-GfZMzYi21FwRO5133H7gtC6m5WaGoVlu6iWWhQadMA_ltSCjmQTWORjhFGSskFC9k_V_WqiYpfIci4 Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 9b612d10ff3b402ea7571f3134c88a11 Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:13:33.678065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b612d10ff3b402ea7571f3134c88a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b612d10ff3b402ea7571f3134c88a11"}]}] Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 9b612d10ff3b402ea7571f3134c88a11 Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1809056818 Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-VolumesSnapshotsTestJSON-1809056818-project Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 30901704e6a7408cb7fdb8d5479dfd8a Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1809056818-project Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'c1de6858-49b0-499f-b3b7-7325ce456ab9'} Oct 14 03:13:33.680315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. (HTTP 404) (Request-ID: req-5cc40f61-7739-47ea-9867-d416cef3b6f6) Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.681199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:33.686096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 03:13:33.687408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-dd47f108-2a18-4f34-810d-4776bf435de1 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] Returning 404 to user: Volume c1de6858-49b0-499f-b3b7-7325ce456ab9 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-dd47f108-2a18-4f34-810d-4776bf435de1 tempest-VolumesSnapshotsTestJSON-1809056818 tempest-VolumesSnapshotsTestJSON-1809056818-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9" status: 404 len: 109 microversion: 2.1 time: 0.035827 Oct 14 03:13:33.688724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 452/873] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:33 2022] GET /compute/v2.1/os-volumes/c1de6858-49b0-499f-b3b7-7325ce456ab9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:34.000840 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:34.001833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:34.009143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:34.009883 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:34.011633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:34.011633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:34.011633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:34.011944 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:34.142494 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:34.151397 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:34.152822 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:34.154091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f5e9811c-065a-4201-9606-3d6316984916 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.157392 Oct 14 03:13:34.154636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 422/874] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:33 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:35.181097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:35.181794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:35.183767 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:35.188898 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.189380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.189838 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.190526 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:35.190977 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:35.191437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:35.327068 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:35.335292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:35.336743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:35.337927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-83610af2-0348-4750-9d20-e82d1c29cf90 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.161954 Oct 14 03:13:35.338480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 453/875] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:35 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:35.715912 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3de955ce-67ff-441b-8855-8109afae8d7b tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Action: 'create', calling method: .version_select at 0x7f2beb774160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-379240899", "metadata": {"Type": "work"}}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:36.338096 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3de955ce-67ff-441b-8855-8109afae8d7b tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.733646 Oct 14 03:13:36.338719 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 423/876] 10.222.0.39 () {60 vars in 1156 bytes} [Fri Oct 14 03:13:35 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 735 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 14 03:13:36.352540 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4af235ce-35d5-4140-8fa4-f66014058ccc tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Calling method '.version_select at 0x7f2beb8e9dc0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:36.363171 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:36.363786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:36.370540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:36.373341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:36.373341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:36.373341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:36.373341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:36.373942 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:36.401044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4af235ce-35d5-4140-8fa4-f66014058ccc tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc" status: 200 len: 352 microversion: 2.1 time: 0.053293 Oct 14 03:13:36.402030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 454/877] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:36 2022] GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:36.505317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:36.513511 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:36.515015 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:36.516381 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-615bda58-8d5a-4e55-bd56-4984cf806f7b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.157298 Oct 14 03:13:36.516933 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 424/878] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:36 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:37.416186 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c58a3a46-96c0-434e-81ed-801af84b4c90 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Calling method '.version_select at 0x7f2beb84db80>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.462818 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c58a3a46-96c0-434e-81ed-801af84b4c90 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc" status: 200 len: 353 microversion: 2.1 time: 0.051144 Oct 14 03:13:37.463378 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 455/879] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:37 2022] GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:37.476294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-77aa32d2-de06-4b6e-9c63-a35974c35646 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Calling method '.version_select at 0x7f2bebb97dc0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.523811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-77aa32d2-de06-4b6e-9c63-a35974c35646 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc" status: 200 len: 353 microversion: 2.1 time: 0.050639 Oct 14 03:13:37.524452 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 425/880] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:37 2022] GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:37.538084 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-707247a7-7825-4bf5-8d30-c208f103ce26 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Calling method '.version_select at 0x7f2beb84d1f0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.542186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.546818 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:37.548900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.549380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.549845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.550543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:37.551055 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:37.551495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:37.721196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-707247a7-7825-4bf5-8d30-c208f103ce26 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc" status: 202 len: 0 microversion: 2.1 time: 0.186956 Oct 14 03:13:37.721792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 456/881] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:13:37 2022] DELETE /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:13:37.730521 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-afb40b0a-f7bf-4269-89a4-02b55a67249c tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Calling method '.version_select at 0x7f2beb844ee0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:37.789487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-afb40b0a-f7bf-4269-89a4-02b55a67249c tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc" status: 200 len: 352 microversion: 2.1 time: 0.063307 Oct 14 03:13:37.790113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 457/882] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:37 2022] GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:37.910318 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:37.918466 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:37.919893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:37.921039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6619d31c-2eaa-48ba-b59f-877d9db089ff tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1745 microversion: 2.20 time: 0.382651 Oct 14 03:13:37.921586 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 426/883] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:37 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1745 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:38.804537 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8bddde8b-6373-43f1-bf3d-76154cc3cc76 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Calling method '.version_select at 0x7f2beb8c2550>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:38.832588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-8bddde8b-6373-43f1-bf3d-76154cc3cc76 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] HTTP exception thrown: Volume e31dca0e-9809-48e5-8e46-33aaab3842bc could not be found. Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8bddde8b-6373-43f1-bf3d-76154cc3cc76 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Request method failure captured: Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc HTTP/1.1 Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNPfx8IopAwIHJV5XCyvjJ8bpv-O-90LhqJnTqF_Mjm5YKtY1-3g1YeaTNMsO9GUyY4vgs9fd6A8lvrVrxhK_kWSgN6TrQfvjefx5Zrr0O-CENPryIntI0AYdasEyosVFtaWhUaSLck80im_OzjvJi9VrSB6ldowFVSxP2Duxx1uuDM Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 272c310114fe49558a1ec0d302ce5cfe Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-VolumesGetTestJSON-1171650621 Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:13:38.833935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/272c310114fe49558a1ec0d302ce5cfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/272c310114fe49558a1ec0d302ce5cfe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/272c310114fe49558a1ec0d302ce5cfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_272c310114fe49558a1ec0d302ce5cfe"}]}] Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-VolumesGetTestJSON-1171650621 Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 272c310114fe49558a1ec0d302ce5cfe Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-VolumesGetTestJSON-1171650621 Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-VolumesGetTestJSON-1171650621-project Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: bad7e2b0895a4c0c8f102ec2edc06c7b Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-VolumesGetTestJSON-1171650621-project Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Volume e31dca0e-9809-48e5-8e46-33aaab3842bc could not be found. Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'e31dca0e-9809-48e5-8e46-33aaab3842bc'} Oct 14 03:13:38.835507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e31dca0e-9809-48e5-8e46-33aaab3842bc could not be found. (HTTP 404) (Request-ID: req-03e26838-ada7-49f3-aeb4-ef07a2d15e98) Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:38.836423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 03:13:38.838122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e31dca0e-9809-48e5-8e46-33aaab3842bc could not be found. Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 03:13:38.839306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e31dca0e-9809-48e5-8e46-33aaab3842bc could not be found. Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e31dca0e-9809-48e5-8e46-33aaab3842bc could not be found. Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8bddde8b-6373-43f1-bf3d-76154cc3cc76 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] Returning 404 to user: Volume e31dca0e-9809-48e5-8e46-33aaab3842bc could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8bddde8b-6373-43f1-bf3d-76154cc3cc76 tempest-VolumesGetTestJSON-1171650621 tempest-VolumesGetTestJSON-1171650621-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc" status: 404 len: 109 microversion: 2.1 time: 0.035228 Oct 14 03:13:38.840500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 458/884] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:38 2022] GET /compute/v2.1/os-volumes/e31dca0e-9809-48e5-8e46-33aaab3842bc => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:13:38.947018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:38.947617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:38.954507 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:38.954983 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:38.955412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:38.956099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:38.956543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:38.957012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:39.089925 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:39.097032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:39.098487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:39.099633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4de4a2fa-d628-4609-b5c7-bce1985bf0d8 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1745 microversion: 2.20 time: 0.156548 Oct 14 03:13:39.100177 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 427/885] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:38 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:40.126732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:40.127342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:40.133315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:40.134377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:40.134860 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:40.135542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:40.136008 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:40.136408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:40.273166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:40.282471 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:40.283923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:40.285093 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2d5f4cc8-3bfa-4084-912c-f820d5835e8d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.163196 Oct 14 03:13:40.285628 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 459/886] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:40 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:41.059709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-74f2116e-0fa6-49b0-ad51-6f06adb5f554 req-fc832ba9-087d-4ea7-a896-2b3d9470405b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372d0ca-25ac-43bd-b519-1700473cb118", "name": "network-vif-plugged", "status": "completed", "tag": "d2229097-29e6-40af-97ca-3612bf109084"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:41.073959 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-74f2116e-0fa6-49b0-ad51-6f06adb5f554 req-fc832ba9-087d-4ea7-a896-2b3d9470405b service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:41.074630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-74f2116e-0fa6-49b0-ad51-6f06adb5f554 req-fc832ba9-087d-4ea7-a896-2b3d9470405b service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:41.075229 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-74f2116e-0fa6-49b0-ad51-6f06adb5f554 req-fc832ba9-087d-4ea7-a896-2b3d9470405b service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:41.087143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-74f2116e-0fa6-49b0-ad51-6f06adb5f554 req-fc832ba9-087d-4ea7-a896-2b3d9470405b service nova] Creating event network-vif-plugged:d2229097-29e6-40af-97ca-3612bf109084 for instance c372d0ca-25ac-43bd-b519-1700473cb118 on hv-cinder-80152 Oct 14 03:13:41.100497 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-74f2116e-0fa6-49b0-ad51-6f06adb5f554 req-fc832ba9-087d-4ea7-a896-2b3d9470405b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044449 Oct 14 03:13:41.107889 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 428/887] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:41.311435 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:41.312751 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:41.319605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:41.320123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:41.320557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:41.322002 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:41.322418 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:41.322841 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:41.477728 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:41.488150 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:41.489577 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:41.490808 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-11c47a7f-6cc4-4d15-bc8e-c92d0dd5467b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.183435 Oct 14 03:13:41.491657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 460/888] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:41 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:42.517162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:42.517950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:42.526355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:42.529750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:42.529750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:42.529750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:42.529750 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:42.530427 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:42.669144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:42.678024 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:42.679687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:42.681386 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9691c8d4-0b7b-4337-a40c-802b3abe7a47 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.168631 Oct 14 03:13:42.682001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 429/889] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:42 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:42.733159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7161ef42-2215-4099-bea4-dd7fdb720652 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb84d3a0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:42.788764 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7161ef42-2215-4099-bea4-dd7fdb720652 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3012e4d1-6b81-443b-8117-e78c53cdd602" status: 200 len: 351 microversion: 2.1 time: 0.059644 Oct 14 03:13:42.790469 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 461/890] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:42 2022] GET /compute/v2.1/os-volumes/3012e4d1-6b81-443b-8117-e78c53cdd602 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:43.708125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:43.708735 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:43.715222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:43.715703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:43.716137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:43.717068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:43.717883 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:43.718195 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:43.856670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:43.863286 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:43.864724 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:43.865908 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-47d3766b-4b55-4519-a4d1-7991524da78d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.161824 Oct 14 03:13:43.866459 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 430/891] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:43 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:44.459614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-88496703-0dcf-4add-8138-c7c7fbd6ac4c tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb7de040>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:44.518302 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-88496703-0dcf-4add-8138-c7c7fbd6ac4c tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1a5dbf11-6008-4f07-ac2d-4e3760b4b4f4" status: 200 len: 351 microversion: 2.1 time: 0.062666 Oct 14 03:13:44.519104 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 462/892] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:44 2022] GET /compute/v2.1/os-volumes/1a5dbf11-6008-4f07-ac2d-4e3760b4b4f4 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:44.892740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:44.893354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:44.903201 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:44.903708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:44.904165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:44.904895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:44.905501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:44.905957 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:45.074453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:45.084748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:45.087992 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:45.087992 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-03c44e56-9169-46f5-ba01-efee50cdedbc tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.199006 Oct 14 03:13:45.088487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 431/893] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:44 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:46.116343 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.117014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:46.123433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:46.123927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:46.124550 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:46.125478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:46.126140 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:46.126568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:46.262985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e020479c-71b2-4cde-96e4-9017e1f70a9f tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb969ee0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.280498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:46.289039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:46.291061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:46.292410 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a5a92948-0208-4cf3-9715-d954defad4ee tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.180429 Oct 14 03:13:46.302123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 463/894] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:46.325921 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e020479c-71b2-4cde-96e4-9017e1f70a9f tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/84a1dc69-5d41-41fd-8242-a2267102877e" status: 200 len: 350 microversion: 2.1 time: 0.070873 Oct 14 03:13:46.326588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 432/895] 10.222.0.39 () {58 vars in 1245 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/os-volumes/84a1dc69-5d41-41fd-8242-a2267102877e => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:46.339901 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4cf49280-37c0-4f35-a86a-2c4b2ce59a00 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb7d9820>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.422180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4cf49280-37c0-4f35-a86a-2c4b2ce59a00 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086187 Oct 14 03:13:46.423489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 464/896] 10.222.0.39 () {58 vars in 1134 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:46.438523 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d1dc8fd6-3122-4727-a037-8e9d1e1388af tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb9d2c10>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.528987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d1dc8fd6-3122-4727-a037-8e9d1e1388af tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094489 Oct 14 03:13:46.529825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 433/897] 10.222.0.39 () {58 vars in 1149 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:46.544166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9f064f09-4462-464e-bf0b-0ee32b5f3504 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb84d160>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.632475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9f064f09-4462-464e-bf0b-0ee32b5f3504 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092185 Oct 14 03:13:46.633047 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 465/898] 10.222.0.39 () {58 vars in 1134 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:46.646647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-848a1f9c-51f9-47f7-98e1-7c82bf362e1c tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb760f70>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.731195 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-848a1f9c-51f9-47f7-98e1-7c82bf362e1c tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088146 Oct 14 03:13:46.731834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 434/899] 10.222.0.39 () {58 vars in 1167 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:46.747331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cbf1d5cb-6ba9-455b-820b-dcf516fbfb37 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb844550>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.830601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cbf1d5cb-6ba9-455b-820b-dcf516fbfb37 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087784 Oct 14 03:13:46.831164 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 466/900] 10.222.0.39 () {58 vars in 1170 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:46.846525 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-eb6648df-ea73-465a-b0e7-513a56d5e4d5 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb8ec1f0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:46.928331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-eb6648df-ea73-465a-b0e7-513a56d5e4d5 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085558 Oct 14 03:13:46.928898 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 435/901] 10.222.0.39 () {58 vars in 1155 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:46.942887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ba234d12-a361-40d8-b5ee-2b29a977f35a tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb84d700>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:47.026005 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ba234d12-a361-40d8-b5ee-2b29a977f35a tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086739 Oct 14 03:13:47.026600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 467/902] 10.222.0.39 () {58 vars in 1188 bytes} [Fri Oct 14 03:13:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:47.040223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-df85f5b8-06af-481a-9240-68182dfdd730 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] Calling method '.version_select at 0x7f2beb774040>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:47.121237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-df85f5b8-06af-481a-9240-68182dfdd730 tempest-VolumesTestJSON-1195681938 tempest-VolumesTestJSON-1195681938-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085172 Oct 14 03:13:47.121824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 436/903] 10.222.0.39 () {58 vars in 1155 bytes} [Fri Oct 14 03:13:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:13:47.319383 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:47.320024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:47.328441 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:47.329169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:47.332914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:47.332914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:47.332914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:47.332914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:47.337110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=88 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:47.497105 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:47.505556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:47.507459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:47.508757 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-eba55485-f2d0-48a3-8947-9f6f893fe649 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.193706 Oct 14 03:13:47.510081 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 468/904] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:47 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:47.551078 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:47.551662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:47.564526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:47.564526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:47.564526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:47.564526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:47.564927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:47.564927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:47.592072 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5ce67a3d-4499-47e6-af08-b9c71eb999dd tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/ips" status: 200 len: 146 microversion: 2.1 time: 0.046580 Oct 14 03:13:47.592647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 437/905] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:13:47 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:48.538624 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:48.539630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:48.546620 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.547244 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.547786 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.548586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:48.549147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:48.549686 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:48.710928 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:48.720400 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:48.721909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:48.723071 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-36a27935-06a8-4a16-aaf1-f50ccff48545 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.188446 Oct 14 03:13:48.724177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 469/906] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:48 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:49.327608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96ccc0e5-2d56-4086-a5a2-e3d49adefed0"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:49.331190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:49.341193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:49.341677 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:49.342157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:49.342866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:49.343329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:49.346721 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:49.748881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:49.750161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:49.757171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:49.757670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:49.758131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:49.765044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:49.765044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:49.765044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:49.904747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:49.926687 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:49.928334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:49.936856 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-015cc0df-e692-40c6-b8ac-5b6207d11879 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.185377 Oct 14 03:13:49.940128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 470/907] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:49 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:50.473563 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e44c6acf-8b55-4397-995a-bdd9482b28a3 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.151375 Oct 14 03:13:50.475147 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 438/908] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:13:49 2022] POST /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments => generated 194 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:13:50.966463 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:50.967680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:50.974657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:50.975354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:50.975973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:50.976849 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:50.977503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:50.978710 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:51.181374 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:51.189957 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:51.191467 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:51.192683 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-651d14cc-e01c-4d76-ac45-eaeb3822ce45 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1740 microversion: 2.20 time: 0.230685 Oct 14 03:13:51.193311 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 471/909] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:50 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:52.230187 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:52.231079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:52.237488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:52.238006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:52.238434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:52.239114 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:52.239561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:52.239976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:52.384381 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:52.393347 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:52.394810 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:52.396008 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2223f3be-87c1-4310-a778-adf1d27566b2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1722 microversion: 2.20 time: 0.170766 Oct 14 03:13:52.400970 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 439/910] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:52 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:53.424498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:53.425243 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:53.431732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:53.437548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:53.437548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:53.437548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:53.437548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:53.437981 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:53.569354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:53.578131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:53.579557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:53.580702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1c659656-1e25-419e-b142-b6532ffb8314 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1722 microversion: 2.20 time: 0.160129 Oct 14 03:13:53.581397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 472/911] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:53 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:54.607415 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:54.608020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:54.614896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:54.615508 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:54.615892 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:54.616576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:54.617020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:54.617438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:54.760449 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:54.768598 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:54.770180 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:54.771331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-77d3a99e-6ab7-4e6f-80f7-5477bd97b612 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1722 microversion: 2.20 time: 0.168573 Oct 14 03:13:54.771881 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 440/912] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:54 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:55.796687 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:55.797345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:55.803372 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:55.803847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:55.804274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:55.804956 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:55.805401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:55.805852 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.079425 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:56.087357 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:56.089359 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:56.090545 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4a867ff3-9cdc-4fcd-8589-f28ea3d26ae2 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1665 microversion: 2.20 time: 0.297683 Oct 14 03:13:56.091097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 473/913] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:55 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1665 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:56.116412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdd9a7ef-8374-4164-a7a5-44a554d8bad5"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:56.118838 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:56.125216 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:56.125693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:56.126156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.126836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:56.127283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:56.127751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:56.590843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:57.130434 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-33dd16f5-8289-4484-a4be-c640ccb4f095 req-0f9a5f83-133d-4322-8650-842327ce71dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372d0ca-25ac-43bd-b519-1700473cb118", "name": "network-vif-unplugged", "status": "completed", "tag": "d2229097-29e6-40af-97ca-3612bf109084"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:57.140823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-33dd16f5-8289-4484-a4be-c640ccb4f095 req-0f9a5f83-133d-4322-8650-842327ce71dd service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:57.141323 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-33dd16f5-8289-4484-a4be-c640ccb4f095 req-0f9a5f83-133d-4322-8650-842327ce71dd service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:57.141743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-33dd16f5-8289-4484-a4be-c640ccb4f095 req-0f9a5f83-133d-4322-8650-842327ce71dd service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:57.152370 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.compute.server_external_events [req-33dd16f5-8289-4484-a4be-c640ccb4f095 req-0f9a5f83-133d-4322-8650-842327ce71dd service nova] Unable to find a host for instance c372d0ca-25ac-43bd-b519-1700473cb118. Dropping event network-vif-unplugged {{(pid=119284) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 14 03:13:57.153226 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-33dd16f5-8289-4484-a4be-c640ccb4f095 req-0f9a5f83-133d-4322-8650-842327ce71dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026696 Oct 14 03:13:57.153797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 474/914] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 14 03:13:57.183529 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0ff10056-6f2b-4015-a9fb-8271ba049ea7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.071217 Oct 14 03:13:57.184132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 441/915] 10.222.0.39 () {62 vars in 1364 bytes} [Fri Oct 14 03:13:56 2022] POST /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/os-volume_attachments => generated 188 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 03:13:57.311049 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:57.311534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:57.317529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:57.323171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:57.323171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:57.323171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:57.323171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:57.323583 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.034436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4ed264ad-bae8-4411-8c4e-3e3385e29e35 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/os-volume_attachments/bdd9a7ef-8374-4164-a7a5-44a554d8bad5" status: 202 len: 0 microversion: 2.20 time: 0.728017 Oct 14 03:13:58.035044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 475/916] 10.222.0.39 () {60 vars in 1457 bytes} [Fri Oct 14 03:13:57 2022] DELETE /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/os-volume_attachments/bdd9a7ef-8374-4164-a7a5-44a554d8bad5 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:13:58.170127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:13:58.170894 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:58.180381 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.180847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.181349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.182092 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.182582 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.183009 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.216207 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119283) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 03:13:58.231571 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:58.233846 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:58.240269 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.245950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.245950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.245950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.245950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.246341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.273412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e4c15c71-9e94-4a8e-90e9-f4842fbf751e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Oct 14 03:13:58.277919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 476/917] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:13:58 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:58.285012 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:58.285630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:58.291519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.292284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.292719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.293404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.294258 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.294688 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.327060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-09b01c41-ed7e-45ef-85ec-ae7ce12a6ede tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/96ccc0e5-2d56-4086-a5a2-e3d49adefed0" status: 200 len: 194 microversion: 2.1 time: 0.046053 Oct 14 03:13:58.327666 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 477/918] 10.222.0.39 () {58 vars in 1413 bytes} [Fri Oct 14 03:13:58 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/96ccc0e5-2d56-4086-a5a2-e3d49adefed0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:13:58.475911 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-83064cc6-d588-4e64-98cf-b7ebfc57002c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "POST /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/action" status: 202 len: 0 microversion: 2.20 time: 0.310216 Oct 14 03:13:58.476505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 442/919] 10.222.0.39 () {62 vars in 1319 bytes} [Fri Oct 14 03:13:58 2022] POST /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:13:58.484856 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:58.485457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:58.491724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.492250 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.492679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.493366 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:58.493966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:58.494390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:58.629100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:58.637885 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:58.639343 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:58.640616 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d9a7e302-f645-4800-8780-587970eeb5c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1673 microversion: 2.20 time: 0.159861 Oct 14 03:13:58.641334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 478/920] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:58 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:13:59.670545 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:59.671148 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:59.676999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:59.677471 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:59.677938 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:59.678621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:59.679068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:59.679485 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:59.809510 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:59.817959 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:59.819391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:13:59.820543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7fe0bb79-0656-4afa-9c50-ebe61a4fd684 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1673 microversion: 2.20 time: 0.154559 Oct 14 03:13:59.821092 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 443/921] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:13:59 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:13:59.973896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:13:59.974434 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:13:59.980899 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:59.981455 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:59.981924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:13:59.982619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:13:59.983072 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:13:59.984109 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:00.008458 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-88f9e5d8-6cda-4268-9c0b-7fc57a2e2c11 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/ips" status: 200 len: 150 microversion: 2.1 time: 0.038467 Oct 14 03:14:00.009256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 479/922] 10.222.0.39 () {58 vars in 1248 bytes} [Fri Oct 14 03:13:59 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:00.846237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:00.846847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:00.853088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:00.853572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:00.854036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:00.855264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:00.855713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:00.856135 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:00.984374 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:00.992345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:00.993799 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:00.995000 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c6ea0c99-ab58-497c-a751-1e60c38f418f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1673 microversion: 2.20 time: 0.152635 Oct 14 03:14:00.995759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 444/923] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:00 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:02.020755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:02.021489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:02.035756 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.036330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.036811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.037546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.038033 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.038463 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.084327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eade560b-606d-4c9d-bb2c-f5289db0f7e5"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:02.086849 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:02.094221 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.094717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.095187 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.095896 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.096353 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.096775 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.188307 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:02.197180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:02.198723 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:02.199914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5dad1c6b-db64-41b0-8824-70e86bc9f637 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.183328 Oct 14 03:14:02.200696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 480/924] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:02 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:02.839522 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f79c1a84-145f-44b5-ac11-f4b9285667c4"}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:02.841955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:02.847763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.848245 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.848679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.849371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:02.849844 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:02.850264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:02.939807 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cd39ea72-d29e-49e1-b005-d249fa064378 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "POST /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859376 Oct 14 03:14:02.943417 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 445/925] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:14:02 2022] POST /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:03.226463 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:03.227308 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:03.230029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:03.235338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:03.235955 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:03.236756 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:03.237709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:03.238198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:03.243445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:03.383344 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:03.392954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:03.398538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:03.398538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-dcd2333e-1e3a-42df-a4d5-3297bf539e28 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.175466 Oct 14 03:14:03.398538 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 446/926] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:03 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:14:03.888874 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:03.971677 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d67413e2-7a69-4457-a3ab-9af3f17b9637 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "POST /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.135935 Oct 14 03:14:03.972442 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 481/927] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:14:02 2022] POST /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:14:04.423283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:04.423921 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:04.437793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:04.437793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:04.437793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:04.437793 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:04.438172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:04.438172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:04.626706 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:04.635178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:04.636924 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:04.638134 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-17bdce1f-f47e-4863-9d95-a42528e7463d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.219301 Oct 14 03:14:04.638803 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 447/928] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:04 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:05.667404 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:05.668196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:05.676433 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:05.676930 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:05.677413 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:05.678125 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:05.678589 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:05.679017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:05.828857 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:05.837896 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:05.840204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:05.841749 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6f904283-f60b-4079-9cc1-df696a2a9ff7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.179574 Oct 14 03:14:05.842863 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 482/929] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:05 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:06.867349 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:06.868588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:06.876012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:06.876501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:06.876929 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:06.877625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:06.878100 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:06.878520 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:07.032451 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:07.041192 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:07.043417 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:07.044665 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f7662ec4-57da-4676-888f-009676242b6b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.181278 Oct 14 03:14:07.045380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 448/930] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:06 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:08.075074 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:08.085742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:08.085742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=38 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:08.085742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:08.085742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:08.086192 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:08.086348 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:08.087133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:08.087972 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:08.227338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:08.235880 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:08.237565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:08.238961 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d0a97e9e-3ed7-43aa-a937-a13e023400c7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.169344 Oct 14 03:14:08.241494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 483/931] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:08 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:09.266153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:09.266766 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:09.273309 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:09.275855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:09.275855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:09.275855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:09.275855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:09.276802 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:09.428515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:09.434927 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:09.436406 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:09.437582 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2eb9fa4d-c7cf-4209-83fd-c98a3427f0f5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.175323 Oct 14 03:14:09.438351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 449/932] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:09 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:10.465913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:10.467785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:10.476493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:10.477258 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:10.477937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:10.479006 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:10.479565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:10.480230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:10.647554 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:10.655857 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:10.657446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:10.658675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-525ef0e8-dee3-48bd-83e3-04a39f4f84b5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.199492 Oct 14 03:14:10.659701 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 484/933] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:10 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:11.685176 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:11.687917 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:11.692317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:11.692839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:11.693269 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:11.693976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:11.694424 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:11.694837 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:11.823052 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:11.831101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:11.832555 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:11.833698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-067ce78d-e4eb-4adf-8cc2-290aad0f184b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.153094 Oct 14 03:14:11.834281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 450/934] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:11 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:12.859659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:12.860266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:12.866869 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:12.867882 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:12.867882 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:12.868423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:12.868873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:12.869288 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:12.999110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:13.007403 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:13.008873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:13.010054 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-56be61bb-9404-4fbe-ad72-8f01d449ee64 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.154317 Oct 14 03:14:13.010799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 485/935] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:12 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:14.034687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:14.035347 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:14.041738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:14.042252 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:14.042688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:14.043475 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:14.043940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:14.044365 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:14.172185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:14.180478 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:14.182474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:14.183643 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d97fcf15-147a-41d2-bf62-79fb50abf701 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.152835 Oct 14 03:14:14.184323 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 451/936] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:14 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:14.985200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:14.987773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:14.994116 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:14.994591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:14.995076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:14.995715 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:14.996196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:14.996620 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:15.036078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ef39237e-db69-483c-8888-2912c6ed7d42 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055433 Oct 14 03:14:15.036685 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 486/937] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:14 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:15.196185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:15.209264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:15.209264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:15.209264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:15.209264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:15.209681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:15.209681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:15.209681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:15.209963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:15.211236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:15.218608 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:15.219160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:15.219604 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:15.220333 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:15.220789 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:15.221212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:15.239283 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-848ca9f2-d62d-4acd-9b06-17dbd68330da tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/96ccc0e5-2d56-4086-a5a2-e3d49adefed0" status: 200 len: 194 microversion: 2.1 time: 0.047303 Oct 14 03:14:15.240191 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 452/938] 10.222.0.39 () {58 vars in 1413 bytes} [Fri Oct 14 03:14:15 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/96ccc0e5-2d56-4086-a5a2-e3d49adefed0 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:15.250329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:15.250833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:15.256688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:15.257173 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:15.257605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:15.258374 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:15.258811 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:15.260466 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:15.350132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lazy-loading 'services' on Instance uuid 7bec501f-50e0-40ea-ba38-c2df09fd439b {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:15.368811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:15.376881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:15.378361 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:15.379529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-53783aef-7b73-43ba-a282-7c95db35f86d tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.174933 Oct 14 03:14:15.380075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 487/939] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:15 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:14:15.498247 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:15.581005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-332da72a-9f15-4a30-8cff-38bf8ca624d9 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/96ccc0e5-2d56-4086-a5a2-e3d49adefed0" status: 202 len: 0 microversion: 2.1 time: 0.334327 Oct 14 03:14:15.581605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 453/940] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:14:15 2022] DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/96ccc0e5-2d56-4086-a5a2-e3d49adefed0 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 03:14:16.405833 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:16.406440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:16.412696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:16.413179 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:16.413608 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:16.414315 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:16.414766 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:16.415184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:16.543295 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:16.551309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:16.552746 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:16.553965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e3b6e1c9-85df-448f-a146-c68b56924383 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.152483 Oct 14 03:14:16.554546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 488/941] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:16 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:17.789391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-37758d21-b3b1-4445-9a83-6e780a50e89e req-f95072d5-da6a-41cf-a823-20477624c8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372d0ca-25ac-43bd-b519-1700473cb118", "name": "network-vif-plugged", "status": "completed", "tag": "d2229097-29e6-40af-97ca-3612bf109084"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:17.789391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-37758d21-b3b1-4445-9a83-6e780a50e89e req-f95072d5-da6a-41cf-a823-20477624c8e6 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:17.789391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-37758d21-b3b1-4445-9a83-6e780a50e89e req-f95072d5-da6a-41cf-a823-20477624c8e6 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:17.789391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-37758d21-b3b1-4445-9a83-6e780a50e89e req-f95072d5-da6a-41cf-a823-20477624c8e6 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:17.791771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-37758d21-b3b1-4445-9a83-6e780a50e89e req-f95072d5-da6a-41cf-a823-20477624c8e6 service nova] Creating event network-vif-plugged:d2229097-29e6-40af-97ca-3612bf109084 for instance c372d0ca-25ac-43bd-b519-1700473cb118 on hv-cinder-80152 Oct 14 03:14:17.791771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-37758d21-b3b1-4445-9a83-6e780a50e89e req-f95072d5-da6a-41cf-a823-20477624c8e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Oct 14 03:14:17.791771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 454/942] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:17.793484 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:17.793484 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:17.793484 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:17.793484 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:17.795131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:17.795131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:17.795131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:17.795131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:17.795525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:17.795525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:17.795727 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:17.795727 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b46f5ef6-80c0-4899-9813-a48143eba5ea tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.150981 Oct 14 03:14:17.795727 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 489/943] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:17 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:14:18.753652 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:18.754408 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:18.760895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:18.762003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:18.762435 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:18.763109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:18.763555 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:18.763973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:18.896384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:18.904521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:18.905996 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:18.907144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-5924fdae-6bc1-454a-a8e9-9a605877c14f tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.158089 Oct 14 03:14:18.907686 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 455/944] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:18 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:19.932314 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:19.932945 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:19.940628 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:19.941124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:19.941562 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:19.942477 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:19.942736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:19.943283 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:20.071091 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:20.079140 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:20.080571 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:20.081730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-465e7c93-443e-440e-b44c-030ceaf0e3f7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.153275 Oct 14 03:14:20.082396 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 490/945] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:19 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:14:21.107461 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:21.108136 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:21.114772 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:21.115251 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:21.115686 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:21.116526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:21.116976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:21.117393 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:21.251021 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:21.259017 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:21.260431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:21.261572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d6ec7cce-851e-4883-b4ae-341591e05827 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1731 microversion: 2.20 time: 0.158932 Oct 14 03:14:21.262442 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 456/946] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:21 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:22.286535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:22.287073 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:22.293543 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:22.294060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:22.294660 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:22.295369 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:22.295830 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:22.296256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:22.422690 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:22.430697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:22.432144 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:22.433828 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5da89a0a-1a17-4f9c-a147-6d90a0711c2c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1718 microversion: 2.20 time: 0.150752 Oct 14 03:14:22.434397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 491/947] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:22 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:24.743614 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:24.744181 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:24.750695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:24.760985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:24.760985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:24.760985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:24.760985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:24.761393 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:24.840222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'services' on Instance uuid eeae0791-4023-4ebe-8511-b09237e0425c {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:25.009230 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-00bf5bc0-3628-4b0c-b8be-d3e69fdb4fa4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments/f79c1a84-145f-44b5-ac11-f4b9285667c4" status: 202 len: 0 microversion: 2.1 time: 0.268716 Oct 14 03:14:25.009354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 457/948] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:14:24 2022] DELETE /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments/f79c1a84-145f-44b5-ac11-f4b9285667c4 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:14:25.018561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:25.020639 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:25.027967 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:25.028444 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:25.028877 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:25.029591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:25.030067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:25.030487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:25.059142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8958291a-4adf-4da5-af91-6db5250449e8 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Oct 14 03:14:25.059704 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 492/949] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:25 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:26.073046 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:26.075412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:26.081779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:26.082276 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:26.083116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:26.083391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:26.083847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:26.084272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:26.115302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-541a3ea6-1c56-4e3d-b35c-89aba8dc55b7 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047123 Oct 14 03:14:26.115854 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 458/950] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:26 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:27.127532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:27.131702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:27.136161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:27.136654 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:27.137090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:27.137808 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:27.138297 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:27.138720 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:27.168030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-be13c6e8-5779-4f34-811d-bc7446b0cdd3 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Oct 14 03:14:27.168580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 493/951] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:27 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:28.180580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:28.185062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:28.189566 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:28.190121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:28.190531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:28.191233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:28.191759 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:28.192091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:28.226281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7c5ea8af-7be0-4c44-a345-12892a2f2ad1 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049796 Oct 14 03:14:28.227136 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 459/952] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:28 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:28.572473 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:28.573040 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:28.580076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:28.580567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:28.581028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:28.581720 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:28.582205 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:28.582629 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:28.611725 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-843ca5fc-46f0-48bf-8d72-a263adc3281e tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/eade560b-606d-4c9d-bb2c-f5289db0f7e5" status: 200 len: 194 microversion: 2.1 time: 0.042957 Oct 14 03:14:28.612298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 494/953] 10.222.0.39 () {58 vars in 1413 bytes} [Fri Oct 14 03:14:28 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/eade560b-606d-4c9d-bb2c-f5289db0f7e5 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:14:28.623565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:28.624090 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:28.630055 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:28.630542 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:28.631001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:28.631978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:28.632431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:28.632856 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:28.714848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lazy-loading 'services' on Instance uuid 7bec501f-50e0-40ea-ba38-c2df09fd439b {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:28.928443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-92a58ace-01c3-4081-8cb4-a5c1b1c4c1b6 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/eade560b-606d-4c9d-bb2c-f5289db0f7e5" status: 202 len: 0 microversion: 2.1 time: 0.309183 Oct 14 03:14:28.929021 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 460/954] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:14:28 2022] DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments/eade560b-606d-4c9d-bb2c-f5289db0f7e5 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:14:29.239121 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:29.241304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:29.247103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.247587 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.248023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.248712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.249165 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.249588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.278099 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1c4be14b-fd27-41ff-a306-980d407a6155 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043155 Oct 14 03:14:29.278645 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 495/955] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:29 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:14:29.343569 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:29.343569 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:29.348716 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.349200 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.349638 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.350368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.350818 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.351240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.376013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:14:29.616535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cc7d898d-608b-4055-9b9c-f7bee215d8cf tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 204 len: 0 microversion: 2.1 time: 0.278979 Oct 14 03:14:29.617328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 461/956] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:29 2022] DELETE /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:14:29.625418 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:29.626049 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:29.632289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.632760 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.633192 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.633971 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:29.634423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:29.634840 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:29.767011 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:29.772281 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a5b4b585-f3c0-4ba8-8d7a-78cc3ad65ad2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1681 microversion: 2.1 time: 0.150681 Oct 14 03:14:29.772893 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 496/957] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:29 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:14:30.796667 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:30.797369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:30.803781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:30.804279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:30.804709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:30.805390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:30.805862 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:30.806279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:30.937128 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:30.944764 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9fd8ee19-6184-4038-8d86-afe747493388 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1681 microversion: 2.1 time: 0.153076 Oct 14 03:14:30.945331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 462/958] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:30 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:31.169058 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:31.173585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:31.177648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:31.178157 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:31.178590 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:31.179271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:31.179718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:31.180135 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:31.213377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-64e096fb-c0dc-46a5-bc5e-aa6457a42ac1 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043969 Oct 14 03:14:31.213377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 497/959] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:31 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:14:31.968542 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:31.969151 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:31.975509 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:31.975989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:31.976422 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:31.977117 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:31.977572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:31.978027 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.105664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:32.113686 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-65e9ac1a-0ed1-455d-a80f-96c53b1be343 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1681 microversion: 2.1 time: 0.149477 Oct 14 03:14:32.114359 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 463/960] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:31 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:32.221337 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:32.223537 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:32.230779 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.231263 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.231697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.232381 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.232842 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.233254 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.249804 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=100 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:32.262591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5eb236aa-579a-4e81-a461-9acd080206ac tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045220 Oct 14 03:14:32.263212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 498/961] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:32 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 14 03:14:32.387052 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:32.389556 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:32.395473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.396005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.396449 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.397186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.397596 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.398044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.436639 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1bc24a55-72a4-4798-a1b3-3f28c7da5e68 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053913 Oct 14 03:14:32.437423 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 464/962] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:14:32 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:14:32.506651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:32.507149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:32.514160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.514586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.515020 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.515700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.516149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.516568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.542443 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:14:32.657577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-22d8a4b2-6e61-445c-9b1f-051712641d4d req-3ada4657-f0df-4c88-a7fe-21e182082992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeae0791-4023-4ebe-8511-b09237e0425c", "name": "network-vif-deleted", "tag": "381a3fc7-a66c-4541-80f1-f293b8f7523d"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:32.670240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-22d8a4b2-6e61-445c-9b1f-051712641d4d req-3ada4657-f0df-4c88-a7fe-21e182082992 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.672663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-22d8a4b2-6e61-445c-9b1f-051712641d4d req-3ada4657-f0df-4c88-a7fe-21e182082992 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.672663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-22d8a4b2-6e61-445c-9b1f-051712641d4d req-3ada4657-f0df-4c88-a7fe-21e182082992 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.686290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-22d8a4b2-6e61-445c-9b1f-051712641d4d req-3ada4657-f0df-4c88-a7fe-21e182082992 service nova] Creating event network-vif-deleted:381a3fc7-a66c-4541-80f1-f293b8f7523d for instance eeae0791-4023-4ebe-8511-b09237e0425c on hv-cinder-80152 Oct 14 03:14:32.692515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-22d8a4b2-6e61-445c-9b1f-051712641d4d req-3ada4657-f0df-4c88-a7fe-21e182082992 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038458 Oct 14 03:14:32.694129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 465/963] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:14:32.892351 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9e2d428d-699c-4d12-96db-f9be31ed1a86 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 204 len: 0 microversion: 2.1 time: 0.389383 Oct 14 03:14:32.892933 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 499/964] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:32 2022] DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:14:32.903212 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:32.903915 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:32.910496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.911183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.911776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:32.912657 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:32.913266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:32.913871 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:33.065045 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:33.072936 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e8e74aa4-cac6-4863-a5fc-8182fb413ba0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1674 microversion: 2.1 time: 0.174125 Oct 14 03:14:33.075405 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 466/965] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:32 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:33.137568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:33.138397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:33.144440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:33.145030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:33.145533 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:33.146498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:33.147025 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:33.147518 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:33.180341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:33.180919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:33.181360 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:33.181861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid eeae0791-4023-4ebe-8511-b09237e0425c {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:33.231449 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:33.243164 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d3401496-4cc0-4ea8-8986-85ad1c6b1292 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1331 microversion: 2.1 time: 0.110199 Oct 14 03:14:33.244077 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 500/966] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:33 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:34.097067 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:34.097681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:34.104112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:34.105090 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:34.105520 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:34.106235 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:34.106688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:34.107111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:34.231862 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:34.239639 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d70754e5-d88e-4c01-9990-72f1733f4c5d tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1674 microversion: 2.1 time: 0.146486 Oct 14 03:14:34.240206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 467/967] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:34 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:34.266128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:34.266673 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:34.272856 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:34.273411 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:34.273982 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:34.274661 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:34.275431 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:34.275543 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:34.306766 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:34.307241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:34.307707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:34.308149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid eeae0791-4023-4ebe-8511-b09237e0425c {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:34.351039 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:34.359563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9434bb46-730a-48d4-bcc5-046fac49c40e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1331 microversion: 2.1 time: 0.097193 Oct 14 03:14:34.360203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 501/968] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:34 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:35.263186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:35.264418 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:35.266884 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:35.271502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:35.271982 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:35.272410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:35.273096 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:35.273545 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:35.273991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:35.383236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:35.383847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:35.390926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:35.391621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:35.392823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:35.393708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:35.394347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:35.394943 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:35.408945 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:35.411107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:35.417223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-eb7a4675-9fd0-46ff-86b0-ab407f240b0a tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1674 microversion: 2.1 time: 0.158133 Oct 14 03:14:35.417836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 468/969] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:35 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:35.429194 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:35.429792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:35.430444 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:35.431051 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lazy-loading 'fault' on Instance uuid eeae0791-4023-4ebe-8511-b09237e0425c {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:35.471847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '410b7c9e93c94ce78d1b5c0e646307a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20fb24be77624e59b8560c7863ca4a46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:35.479639 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7e6cebcc-360c-49d2-a5e5-d9f568481e4a tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 200 len: 1331 microversion: 2.1 time: 0.100076 Oct 14 03:14:35.480130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 502/970] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:35 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:36.101342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-47bc463a-4090-4d47-a8ac-ac93fda1185d req-b8333602-124a-4f15-a92f-e4772d4c71e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bec501f-50e0-40ea-ba38-c2df09fd439b", "name": "network-vif-deleted", "tag": "4a6bff08-0d49-4863-be8c-5097b81b1188"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:14:36.112003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-47bc463a-4090-4d47-a8ac-ac93fda1185d req-b8333602-124a-4f15-a92f-e4772d4c71e4 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:36.112474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-47bc463a-4090-4d47-a8ac-ac93fda1185d req-b8333602-124a-4f15-a92f-e4772d4c71e4 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:36.112895 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-47bc463a-4090-4d47-a8ac-ac93fda1185d req-b8333602-124a-4f15-a92f-e4772d4c71e4 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:36.124206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-47bc463a-4090-4d47-a8ac-ac93fda1185d req-b8333602-124a-4f15-a92f-e4772d4c71e4 service nova] Creating event network-vif-deleted:4a6bff08-0d49-4863-be8c-5097b81b1188 for instance 7bec501f-50e0-40ea-ba38-c2df09fd439b on hv-cinder-80152 Oct 14 03:14:36.129426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-47bc463a-4090-4d47-a8ac-ac93fda1185d req-b8333602-124a-4f15-a92f-e4772d4c71e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032006 Oct 14 03:14:36.130551 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 469/971] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:14:36.441176 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:36.441904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:36.449691 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:36.450355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:36.450831 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:36.452278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:36.452732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:36.453464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:36.489173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:36.489652 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:36.490146 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:36.490593 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lazy-loading 'fault' on Instance uuid 7bec501f-50e0-40ea-ba38-c2df09fd439b {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:36.504288 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:36.505229 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:36.512479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:36.513064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:36.518448 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:36.519353 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:36.523472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:36.523472 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:36.530975 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:36.536672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c HTTP/1.1 Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:14:36.538483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:36.540141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'eeae0791-4023-4ebe-8511-b09237e0425c'} Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:36.541068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:36.542663 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:36.544131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2308387f-9cd7-4dd2-9fec-cb79ba89059b tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1327 microversion: 2.1 time: 0.101757 Oct 14 03:14:36.544131 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 503/972] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:36 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:36.544313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:36.544313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ec8b6d9e-0460-4bed-a97a-e9071ed17636 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 404 len: 111 microversion: 2.1 time: 0.042706 Oct 14 03:14:36.548416 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 470/973] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:36 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 03:14:36.594416 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c3a27183-d8f7-432f-b971-d50413b54923 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '.version_select at 0x7f2beb8d9820>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:36.667599 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c3a27183-d8f7-432f-b971-d50413b54923 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726210303" status: 202 len: 0 microversion: 2.1 time: 0.111533 Oct 14 03:14:36.671659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 504/974] 10.222.0.39 () {58 vars in 1221 bytes} [Fri Oct 14 03:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726210303 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:14:37.563297 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:37.563855 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:37.570262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:37.570737 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:37.571167 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:37.571854 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:37.572339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:37.572758 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:37.603984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:37.604456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:37.604891 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:37.605333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lazy-loading 'fault' on Instance uuid 7bec501f-50e0-40ea-ba38-c2df09fd439b {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:37.648741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:37.657631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8d465aa8-3299-4c70-866c-6265b0db76c5 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1327 microversion: 2.1 time: 0.098652 Oct 14 03:14:37.658222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 471/975] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:37 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:38.680347 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:38.680994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:38.687878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:38.688363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:38.688834 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:38.689532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:38.690014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:38.690441 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:38.721419 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:38.721847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:38.722269 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:38.722715 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lazy-loading 'fault' on Instance uuid 7bec501f-50e0-40ea-ba38-c2df09fd439b {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:38.762431 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:38.770712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e4799fb9-1b79-4303-897a-227f6adb81c0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1327 microversion: 2.1 time: 0.094271 Oct 14 03:14:38.771268 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 505/976] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:38 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:39.793839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:39.794459 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:39.801061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:39.801545 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:39.802016 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:39.802722 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:39.803175 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:39.803598 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:39.834949 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:39.835436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:39.835875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:39.836321 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lazy-loading 'fault' on Instance uuid 7bec501f-50e0-40ea-ba38-c2df09fd439b {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:14:39.879980 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1c279c2f7f404ab9c846a3ba594886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5470d8ee28f74b4eb385a90c33a514b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:39.887609 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-11e6e34d-281f-48ad-b42c-a3749e5bacee tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 200 len: 1327 microversion: 2.1 time: 0.097789 Oct 14 03:14:39.888175 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 472/977] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:39 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:40.817355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:40.817927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:40.820273 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:40.825554 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:40.826076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:40.826512 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:40.827202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:40.827650 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:40.828065 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:40.842043 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c HTTP/1.1 Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:14:40.843702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.845210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'eeae0791-4023-4ebe-8511-b09237e0425c'} Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:40.846180 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.847662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.849363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:40.849363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-06b7ccf4-da47-490d-86c0-258b1da2de74 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 404 len: 111 microversion: 2.1 time: 0.031578 Oct 14 03:14:40.849363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 506/978] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:40 2022] DELETE /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:40.853267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:40.853903 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: eeae0791-4023-4ebe-8511-b09237e0425c] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:40.860849 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:40.861329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:40.862037 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:40.862724 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:40.863169 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:40.863585 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:40.877496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c HTTP/1.1 Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:14:40.879036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.880440 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'eeae0791-4023-4ebe-8511-b09237e0425c'} Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:40.881278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. Oct 14 03:14:40.882836 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.884517 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance eeae0791-4023-4ebe-8511-b09237e0425c could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:40.884517 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-28cfeca5-ec85-4c19-8333-9e671543cfb4 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c" status: 404 len: 111 microversion: 2.1 time: 0.030902 Oct 14 03:14:40.884517 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 473/979] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:40 2022] GET /compute/v2.1/servers/eeae0791-4023-4ebe-8511-b09237e0425c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:40.911365 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:40.911976 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:40.918041 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:40.918520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:40.918954 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:40.919646 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:40.920728 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:40.921153 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:40.935796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] HTTP exception thrown: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Request method failure captured: Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b HTTP/1.1 Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNKBPksE4oWnYQ-3VWpnw8PZLzHdWBKdybCJIRXbef7HW5UgYarsATq5W8eARtcoIBd3AQ94Xp5wrIFjFMKFzGlNjhhHUrodqL6-B4Y8tzyihZoKOAPWT1S8y4Eu7mFBHI53Ikj-rqIubqmVPGK9YwIxtQVh89ZXI7XVRe3iIymEP1k Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:14:40.937293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5470d8ee28f74b4eb385a90c33a514b8"}]}] Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: fb1c279c2f7f404ab9c846a3ba594886 Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:40.938990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': '7bec501f-50e0-40ea-ba38-c2df09fd439b'} Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:40.939994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:40.941568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:40.943001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Returning 404 to user: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:40.943001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3195be53-744b-49c5-9bc2-02fb8358a33f tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 404 len: 111 microversion: 2.1 time: 0.031573 Oct 14 03:14:40.943001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 507/980] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:40 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:40.947733 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-08106469-cb71-4009-b645-f5ec56cfcacb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '.version_select at 0x7f2beb8d03a0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:41.042347 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-08106469-cb71-4009-b645-f5ec56cfcacb tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-822883232" status: 202 len: 0 microversion: 2.1 time: 0.098522 Oct 14 03:14:41.042926 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 474/981] 10.222.0.39 () {58 vars in 1218 bytes} [Fri Oct 14 03:14:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-822883232 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:14:42.165429 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:42.165978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:42.173148 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:42.173632 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:42.174115 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:42.174873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:42.175242 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:42.179975 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:42.191787 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de HTTP/1.1 Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:14:42.193280 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.194937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'ccd7272a-6200-4e43-a875-486a9dfdf4de'} Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:42.195737 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.196990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.198215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:42.198215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-acbf3ac2-6ba4-4958-8439-82c264acb81e tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 404 len: 111 microversion: 2.1 time: 0.033481 Oct 14 03:14:42.198215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 508/982] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:42 2022] DELETE /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:42.203250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:42.203852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: ccd7272a-6200-4e43-a875-486a9dfdf4de] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:42.211010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:42.211678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:42.212104 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:42.212786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:42.213232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:42.213648 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:42.226448 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de HTTP/1.1 Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:14:42.227953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'ccd7272a-6200-4e43-a875-486a9dfdf4de'} Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:42.230453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. Oct 14 03:14:42.231902 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.233693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance ccd7272a-6200-4e43-a875-486a9dfdf4de could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:42.233693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6484fc5c-fe9a-46fa-a247-9b76c99e9a68 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de" status: 404 len: 111 microversion: 2.1 time: 0.029934 Oct 14 03:14:42.233693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 475/983] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:42 2022] GET /compute/v2.1/servers/ccd7272a-6200-4e43-a875-486a9dfdf4de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:42.239701 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:42.240196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:42.246208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:42.246695 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:42.247128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:42.247821 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:42.248923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:42.249349 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:42.262750 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 HTTP/1.1 Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:14:42.264394 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.266137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': '174ff84e-3115-4222-a659-4725858ef844'} Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:42.267110 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.268605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.270271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:42.270271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2eabee48-1091-47eb-b82d-09a47305b200 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 404 len: 111 microversion: 2.1 time: 0.030719 Oct 14 03:14:42.270271 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 509/984] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:42 2022] DELETE /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:42.274960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:42.275565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 174ff84e-3115-4222-a659-4725858ef844] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:42.282192 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:42.282664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:42.283089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:42.284145 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:42.284633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:42.288920 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:42.299463 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 HTTP/1.1 Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:14:42.301061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.302669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '174ff84e-3115-4222-a659-4725858ef844'} Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:42.303747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. Oct 14 03:14:42.305131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:42.306355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance 174ff84e-3115-4222-a659-4725858ef844 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:42.306355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7f139e47-1831-4b78-b761-b8dfe534a563 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844" status: 404 len: 111 microversion: 2.1 time: 0.031662 Oct 14 03:14:42.306355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 476/985] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:42 2022] GET /compute/v2.1/servers/174ff84e-3115-4222-a659-4725858ef844 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:43.632312 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:43.632828 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:43.639575 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:43.640060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:43.640487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:43.641167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:43.641641 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:43.642060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:43.655549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e HTTP/1.1 Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:14:43.657080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.658854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': '73287e1d-7bf7-4ebb-93e4-7e16bd29655e'} Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:43.659732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.661163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.662950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:43.662950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e23b1e34-2f1f-4780-b2a1-66f971754834 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "DELETE /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 404 len: 111 microversion: 2.1 time: 0.029983 Oct 14 03:14:43.662950 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 510/986] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:43 2022] DELETE /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:43.666801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:43.667426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] [instance: 73287e1d-7bf7-4ebb-93e4-7e16bd29655e] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:43.674145 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:43.674624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:43.675061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:43.675748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:43.676198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:43.676618 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:43.690003 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] HTTP exception thrown: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Request method failure captured: Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e HTTP/1.1 Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ81iRfS6JVeCb4-GnUE77bYdQASF6J-ZUCKNG3L9rKSkhuYFSg9T3EkTMhT0pxDSiGPj5Nqxn06vswNCNHoIeS4ewNa5ia60LNk_adrF_5W3r-1SsUL5YK069lcV3CP11164l4Vdi0chS69kXqsSGn4-gE2BEqQ9Zt5svodyUi6hM Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:14:43.691498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20fb24be77624e59b8560c7863ca4a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20fb24be77624e59b8560c7863ca4a46"}]}] Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 20fb24be77624e59b8560c7863ca4a46 Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561806553 Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 410b7c9e93c94ce78d1b5c0e646307a2 Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeNegativeTest-1561806553-project Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.693093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '73287e1d-7bf7-4ebb-93e4-7e16bd29655e'} Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:43.694094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. Oct 14 03:14:43.695338 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:43.696553 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] Returning 404 to user: Instance 73287e1d-7bf7-4ebb-93e4-7e16bd29655e could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:43.696553 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9b350156-1319-49e5-b078-aac9abbb12d2 tempest-AttachVolumeNegativeTest-1561806553 tempest-AttachVolumeNegativeTest-1561806553-project] 10.222.0.39 "GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e" status: 404 len: 111 microversion: 2.1 time: 0.029888 Oct 14 03:14:43.696553 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 477/987] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:43 2022] GET /compute/v2.1/servers/73287e1d-7bf7-4ebb-93e4-7e16bd29655e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:44.324696 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:44.325184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:44.331140 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:44.331619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:44.332052 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:44.332738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:44.333188 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:44.333614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:44.346827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] HTTP exception thrown: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Request method failure captured: Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b HTTP/1.1 Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNKBPksE4oWnYQ-3VWpnw8PZLzHdWBKdybCJIRXbef7HW5UgYarsATq5W8eARtcoIBd3AQ94Xp5wrIFjFMKFzGlNjhhHUrodqL6-B4Y8tzyihZoKOAPWT1S8y4Eu7mFBHI53Ikj-rqIubqmVPGK9YwIxtQVh89ZXI7XVRe3iIymEP1k Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:14:44.348377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5470d8ee28f74b4eb385a90c33a514b8"}]}] Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: fb1c279c2f7f404ab9c846a3ba594886 Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.349963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': '7bec501f-50e0-40ea-ba38-c2df09fd439b'} Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:44.350754 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.352331 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.353732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Returning 404 to user: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:44.353732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4e18a35e-8ce5-4ff6-8206-46caf89fd044 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 404 len: 111 microversion: 2.1 time: 0.028881 Oct 14 03:14:44.353732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 511/988] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:44 2022] DELETE /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:44.359210 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:44.360153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 7bec501f-50e0-40ea-ba38-c2df09fd439b] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:44.366244 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:44.366768 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:44.367194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:44.367878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:44.368327 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:44.368749 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:44.382864 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] HTTP exception thrown: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Request method failure captured: Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b HTTP/1.1 Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNKBPksE4oWnYQ-3VWpnw8PZLzHdWBKdybCJIRXbef7HW5UgYarsATq5W8eARtcoIBd3AQ94Xp5wrIFjFMKFzGlNjhhHUrodqL6-B4Y8tzyihZoKOAPWT1S8y4Eu7mFBHI53Ikj-rqIubqmVPGK9YwIxtQVh89ZXI7XVRe3iIymEP1k Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:14:44.384385 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5470d8ee28f74b4eb385a90c33a514b8"}]}] Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: fb1c279c2f7f404ab9c846a3ba594886 Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.386012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '7bec501f-50e0-40ea-ba38-c2df09fd439b'} Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:44.392787 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. Oct 14 03:14:44.394713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:44.396426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Returning 404 to user: Instance 7bec501f-50e0-40ea-ba38-c2df09fd439b could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:44.396426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f6a59f14-048b-44ca-8bee-dfa2650c7935 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b" status: 404 len: 111 microversion: 2.1 time: 0.031076 Oct 14 03:14:44.396426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 478/989] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:44 2022] GET /compute/v2.1/servers/7bec501f-50e0-40ea-ba38-c2df09fd439b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:45.726297 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:45.728269 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:45.738836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:45.740261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:45.741046 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:45.742459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:45.743607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:45.744213 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:45.763510 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] HTTP exception thrown: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Request method failure captured: Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 HTTP/1.1 Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNKBPksE4oWnYQ-3VWpnw8PZLzHdWBKdybCJIRXbef7HW5UgYarsATq5W8eARtcoIBd3AQ94Xp5wrIFjFMKFzGlNjhhHUrodqL6-B4Y8tzyihZoKOAPWT1S8y4Eu7mFBHI53Ikj-rqIubqmVPGK9YwIxtQVh89ZXI7XVRe3iIymEP1k Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:14:45.767393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5470d8ee28f74b4eb385a90c33a514b8"}]}] Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: fb1c279c2f7f404ab9c846a3ba594886 Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.769028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': '258e7a24-1f44-4662-b9b0-4f35c319a2d2'} Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:45.770001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.771755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.773517 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Returning 404 to user: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:45.773517 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-55b38c4f-b509-4709-9327-cba71fc4fbf0 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "DELETE /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 404 len: 111 microversion: 2.1 time: 0.046548 Oct 14 03:14:45.779806 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:45.780436 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] [instance: 258e7a24-1f44-4662-b9b0-4f35c319a2d2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:45.785408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 512/990] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:14:45 2022] DELETE /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:45.787601 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:45.788094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:45.788532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:45.789234 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:45.789905 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:45.790491 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:45.807020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] HTTP exception thrown: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Request method failure captured: Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 HTTP/1.1 Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNKBPksE4oWnYQ-3VWpnw8PZLzHdWBKdybCJIRXbef7HW5UgYarsATq5W8eARtcoIBd3AQ94Xp5wrIFjFMKFzGlNjhhHUrodqL6-B4Y8tzyihZoKOAPWT1S8y4Eu7mFBHI53Ikj-rqIubqmVPGK9YwIxtQVh89ZXI7XVRe3iIymEP1k Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:14:45.808845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5470d8ee28f74b4eb385a90c33a514b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5470d8ee28f74b4eb385a90c33a514b8"}]}] Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 5470d8ee28f74b4eb385a90c33a514b8 Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833879438 Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: fb1c279c2f7f404ab9c846a3ba594886 Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeTestJSON-1833879438-project Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.811224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '258e7a24-1f44-4662-b9b0-4f35c319a2d2'} Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:14:45.812064 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. Oct 14 03:14:45.813515 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:14:45.815580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] Returning 404 to user: Instance 258e7a24-1f44-4662-b9b0-4f35c319a2d2 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:14:45.816585 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-193afb37-5a31-4271-8c28-b5e34a451787 tempest-AttachVolumeTestJSON-1833879438 tempest-AttachVolumeTestJSON-1833879438-project] 10.222.0.39 "GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2" status: 404 len: 111 microversion: 2.1 time: 0.043704 Oct 14 03:14:45.819477 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 479/991] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:14:45 2022] GET /compute/v2.1/servers/258e7a24-1f44-4662-b9b0-4f35c319a2d2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:55.802680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:55.804863 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:55.807388 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=13 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:55.808060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:55.812750 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:55.813236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:55.813659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:55.814427 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:55.814874 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:55.815306 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:55.845157 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0af6ea46-99ea-496f-94e1-040c3e40c08a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046687 Oct 14 03:14:55.845707 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 513/992] 10.222.0.39 () {60 vars in 1343 bytes} [Fri Oct 14 03:14:55 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:14:55.910373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:55.910940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:55.913705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:55.914437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=33 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:55.921842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:55.921842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:55.921842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:55.921842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:55.922206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:55.922206 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:55.947409 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:14:56.234654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e7741738-4195-44f9-8410-df9d45932065 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 204 len: 0 microversion: 2.20 time: 0.327819 Oct 14 03:14:56.235248 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 480/993] 10.222.0.39 () {60 vars in 1280 bytes} [Fri Oct 14 03:14:55 2022] DELETE /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 14 03:14:56.243946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:56.244559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:56.251756 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:56.252237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:56.252670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:56.253391 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:56.253876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:56.254303 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:56.382909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:56.390968 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:56.392396 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:56.393600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4146298c-033c-4212-8fb7-f9ab75c57fbb tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.153847 Oct 14 03:14:56.394170 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 514/994] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:56 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:57.419418 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:57.420106 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:57.426312 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:57.426785 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:57.427218 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:57.427903 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:57.428354 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:57.428774 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:57.569741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:57.572681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:57.574128 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:57.575278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-88919c17-915a-4a6a-ab73-bd3deac3befa tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.160270 Oct 14 03:14:57.575839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 481/995] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:57 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:14:58.601338 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:58.601983 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:58.608255 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:58.608766 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:58.609200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:58.609929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:58.610397 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:58.610823 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:58.747978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:58.756906 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:58.758385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:58.759542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-732209a2-35cd-4b1f-8602-86e348e8acc7 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.162740 Oct 14 03:14:58.760084 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 515/996] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:58 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:14:59.784549 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:14:59.785190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:14:59.791713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:59.792224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:59.792660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:59.793348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:14:59.793858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:14:59.799273 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:14:59.922984 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:59.931058 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:59.932477 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:14:59.933617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2d045333-a9a5-4153-9db9-6758a3c8d3c0 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.153026 Oct 14 03:14:59.934203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 482/997] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:14:59 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:00.959542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:00.960159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:00.966576 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:00.967675 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:00.968114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:00.968805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:00.969261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:00.969689 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:01.096588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:01.104652 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:01.106129 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:01.107291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-186f703a-86ca-4a32-bbcb-0c7d2a04b374 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.151678 Oct 14 03:15:01.107850 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 516/998] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:00 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:02.133487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:02.134125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:02.140466 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:02.140937 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:02.141363 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:02.142076 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:02.142524 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:02.142940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:02.269711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:02.277792 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:02.279200 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:02.281125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-67e4ea95-bcc3-436c-a5a9-37690340b6a4 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.150821 Oct 14 03:15:02.281805 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 483/999] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:02 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:03.306239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:03.306785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:03.313976 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:03.314458 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:03.314892 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:03.315583 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:03.316034 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:03.316461 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:03.447613 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:03.455886 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:03.457346 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:03.458563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ca2ea2d3-d213-4a59-a937-82fa92880f4b tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1724 microversion: 2.20 time: 0.156320 Oct 14 03:15:03.459119 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 517/1000] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:03 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 03:15:04.230274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-a6d9c3b8-6039-4cf4-8c0d-6d81b724403f req-e72756e3-9e26-4c9c-bdd7-baef9ba7e95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372d0ca-25ac-43bd-b519-1700473cb118", "name": "network-vif-deleted", "tag": "d2229097-29e6-40af-97ca-3612bf109084"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:15:04.243760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-a6d9c3b8-6039-4cf4-8c0d-6d81b724403f req-e72756e3-9e26-4c9c-bdd7-baef9ba7e95c service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:04.243760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-a6d9c3b8-6039-4cf4-8c0d-6d81b724403f req-e72756e3-9e26-4c9c-bdd7-baef9ba7e95c service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:04.243760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-a6d9c3b8-6039-4cf4-8c0d-6d81b724403f req-e72756e3-9e26-4c9c-bdd7-baef9ba7e95c service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:04.259982 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-a6d9c3b8-6039-4cf4-8c0d-6d81b724403f req-e72756e3-9e26-4c9c-bdd7-baef9ba7e95c service nova] Creating event network-vif-deleted:d2229097-29e6-40af-97ca-3612bf109084 for instance c372d0ca-25ac-43bd-b519-1700473cb118 on hv-cinder-80152 Oct 14 03:15:04.265835 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-a6d9c3b8-6039-4cf4-8c0d-6d81b724403f req-e72756e3-9e26-4c9c-bdd7-baef9ba7e95c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038445 Oct 14 03:15:04.266981 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 484/1001] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:15:04.484833 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:04.485443 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:04.492284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:04.492963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:04.494036 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:04.494985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:04.495440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:04.496023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:04.563259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:04.571711 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:04.573168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:04.574441 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b5a96ce3-0d44-4208-a5c0-5e3c4dc811e9 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1657 microversion: 2.20 time: 0.093954 Oct 14 03:15:04.574996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 518/1002] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:04 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:05.601113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:05.601864 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:05.608029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:05.608526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:05.608955 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:05.609640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:05.610126 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:05.610548 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:05.674105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:05.682063 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:05.683479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:05.684625 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1bda8e05-5376-42cb-82eb-3b730fee2f3c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1657 microversion: 2.20 time: 0.088353 Oct 14 03:15:05.685172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 485/1003] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:05 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1657 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:06.710915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:06.711830 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:06.718621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:06.719104 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:06.719597 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:06.720292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:06.720743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:06.721166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:06.752205 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:06.752683 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:06.753119 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:06.753560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lazy-loading 'fault' on Instance uuid c372d0ca-25ac-43bd-b519-1700473cb118 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:15:06.797393 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:06.805277 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:06.806748 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab344e29f747423fb8766f2d8fbfef0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f278e0f09c45ca8ab33cd9e102446c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:15:06.807891 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cdc37384-7c08-47b7-9f1c-9ba5b56b5858 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 200 len: 1371 microversion: 2.20 time: 0.100845 Oct 14 03:15:06.808459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 519/1004] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:06 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 03:15:07.834245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:07.834859 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:07.840747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:07.841224 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:07.841652 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:07.842359 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:07.842806 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:07.843221 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:07.857054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] HTTP exception thrown: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Request method failure captured: Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 HTTP/1.1 Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ-XmNkdoks1GQ-tEnOolYrAfXAe_V0NF5SqKOz8urLoHOgMLmxSTWBagnxY9yuV83St0mgb59FKGX05SX1vph3ppKQfIVEWQ3pBh2aNf8clqXLVAzzoKuUcKe8lD-RB2KQrznl9Kb7kx0HgQ7YQbD1SFXjy9n5tIcCVinUOqfkK4o Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:15:07.858771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_55f278e0f09c45ca8ab33cd9e102446c"}]}] Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: ab344e29f747423fb8766f2d8fbfef0b Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:07.860540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'c372d0ca-25ac-43bd-b519-1700473cb118'} Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:07.865973 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:07.867953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:07.869456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Returning 404 to user: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:07.869456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0138c4d2-490e-4c02-aa8f-ecf95e45655c tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 404 len: 111 microversion: 2.20 time: 0.030349 Oct 14 03:15:07.869456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 486/1005] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:07 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:07.873026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-942ae315-6dad-41aa-b8c2-6fc642173b3a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '.version_select at 0x7f2beb9a8b80>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:07.969878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-942ae315-6dad-41aa-b8c2-6fc642173b3a tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-906154666" status: 204 len: 0 microversion: 2.20 time: 0.100562 Oct 14 03:15:07.971373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 520/1006] 10.222.0.39 () {60 vars in 1259 bytes} [Fri Oct 14 03:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-906154666 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 03:15:12.369112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:12.369600 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:12.376013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:12.376521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:12.376953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:12.378223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:12.378693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:12.379196 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:12.400161 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] HTTP exception thrown: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Request method failure captured: Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: DELETE /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 HTTP/1.1 Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ-XmNkdoks1GQ-tEnOolYrAfXAe_V0NF5SqKOz8urLoHOgMLmxSTWBagnxY9yuV83St0mgb59FKGX05SX1vph3ppKQfIVEWQ3pBh2aNf8clqXLVAzzoKuUcKe8lD-RB2KQrznl9Kb7kx0HgQ7YQbD1SFXjy9n5tIcCVinUOqfkK4o Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:15:12.401858 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_55f278e0f09c45ca8ab33cd9e102446c"}]}] Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: ab344e29f747423fb8766f2d8fbfef0b Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.403333 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'c372d0ca-25ac-43bd-b519-1700473cb118'} Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:12.404109 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.405828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.407790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Returning 404 to user: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:12.407790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2872abb8-e402-4baa-8bf6-c2db931bc79e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 404 len: 111 microversion: 2.20 time: 0.038376 Oct 14 03:15:12.407790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 487/1007] 10.222.0.39 () {60 vars in 1280 bytes} [Fri Oct 14 03:15:12 2022] DELETE /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:12.412409 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:12.416000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: c372d0ca-25ac-43bd-b519-1700473cb118] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:12.420087 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:12.420485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:12.421282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:12.422330 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:12.422641 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:12.423132 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:12.439470 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] HTTP exception thrown: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Request method failure captured: Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 HTTP/1.1 Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ-XmNkdoks1GQ-tEnOolYrAfXAe_V0NF5SqKOz8urLoHOgMLmxSTWBagnxY9yuV83St0mgb59FKGX05SX1vph3ppKQfIVEWQ3pBh2aNf8clqXLVAzzoKuUcKe8lD-RB2KQrznl9Kb7kx0HgQ7YQbD1SFXjy9n5tIcCVinUOqfkK4o Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:15:12.442202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_55f278e0f09c45ca8ab33cd9e102446c"}]}] Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: ab344e29f747423fb8766f2d8fbfef0b Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.446969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'c372d0ca-25ac-43bd-b519-1700473cb118'} Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:12.448078 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. Oct 14 03:15:12.449947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:12.451279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Returning 404 to user: Instance c372d0ca-25ac-43bd-b519-1700473cb118 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:12.451279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-29a289e9-ad87-45f3-8638-ef6111ef64dd tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118" status: 404 len: 111 microversion: 2.20 time: 0.035595 Oct 14 03:15:12.451279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 521/1008] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:12 2022] GET /compute/v2.1/servers/c372d0ca-25ac-43bd-b519-1700473cb118 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:20.046392 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:20.046969 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:20.053570 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:20.054149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:20.054591 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:20.055342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:20.055900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:20.056222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] HTTP exception thrown: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Request method failure captured: Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: DELETE /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 HTTP/1.1 Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNJ-XmNkdoks1GQ-tEnOolYrAfXAe_V0NF5SqKOz8urLoHOgMLmxSTWBagnxY9yuV83St0mgb59FKGX05SX1vph3ppKQfIVEWQ3pBh2aNf8clqXLVAzzoKuUcKe8lD-RB2KQrznl9Kb7kx0HgQ7YQbD1SFXjy9n5tIcCVinUOqfkK4o Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:15:20.072796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_55f278e0f09c45ca8ab33cd9e102446c"}]}] Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: ab344e29f747423fb8766f2d8fbfef0b Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.074999 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'd95dafdb-f3bf-4f25-96bc-6595e7f52a89'} Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:20.076287 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.078184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.079947 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Returning 404 to user: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:20.079947 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c2e635b0-45b6-4b85-9804-3f36d26079e5 tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 404 len: 111 microversion: 2.20 time: 0.030531 Oct 14 03:15:20.079947 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 488/1009] 10.222.0.39 () {60 vars in 1280 bytes} [Fri Oct 14 03:15:20 2022] DELETE /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:20.082042 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:15:20.082656 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] [instance: d95dafdb-f3bf-4f25-96bc-6595e7f52a89] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:15:20.089121 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:20.089601 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:20.090082 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:20.090776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:15:20.091230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:15:20.091652 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:15:20.105045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] HTTP exception thrown: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Request method failure captured: Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 HTTP/1.1 Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNJ-XmNkdoks1GQ-tEnOolYrAfXAe_V0NF5SqKOz8urLoHOgMLmxSTWBagnxY9yuV83St0mgb59FKGX05SX1vph3ppKQfIVEWQ3pBh2aNf8clqXLVAzzoKuUcKe8lD-RB2KQrznl9Kb7kx0HgQ7YQbD1SFXjy9n5tIcCVinUOqfkK4o Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:15:20.106615 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/55f278e0f09c45ca8ab33cd9e102446c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_55f278e0f09c45ca8ab33cd9e102446c"}]}] Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 55f278e0f09c45ca8ab33cd9e102446c Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-690408365 Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: ab344e29f747423fb8766f2d8fbfef0b Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-AttachVolumeShelveTestJSON-690408365-project Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.108173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'd95dafdb-f3bf-4f25-96bc-6595e7f52a89'} Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:15:20.108923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. Oct 14 03:15:20.110193 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:15:20.111314 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] Returning 404 to user: Instance d95dafdb-f3bf-4f25-96bc-6595e7f52a89 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:15:20.111314 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7b907587-6684-45ad-9213-63c6a6098f7e tempest-AttachVolumeShelveTestJSON-690408365 tempest-AttachVolumeShelveTestJSON-690408365-project] 10.222.0.39 "GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89" status: 404 len: 111 microversion: 2.20 time: 0.030464 Oct 14 03:15:20.111314 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 522/1010] 10.222.0.39 () {60 vars in 1277 bytes} [Fri Oct 14 03:15:20 2022] GET /compute/v2.1/servers/d95dafdb-f3bf-4f25-96bc-6595e7f52a89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 03:15:42.865278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:42.867613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:43.260156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1ae38162-04a0-49de-ba3f-51216c85ff93 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Action: 'create', calling method: .version_select at 0x7f2beb9d9ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1759476879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtr3mJIOJVSeoUA+3qKLuvdsF1NOxs6SjUdMcpjK28BFAu+62xLeTLOoqYMXaMLa1nhPgZFsD1GxkUfG2YD6bJth4pmuPHdIXWgpVDE2KXevr96XwOJt27zyA4jkBy4vA=="}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:15:43.275311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-1ae38162-04a0-49de-ba3f-51216c85ff93 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Getting quotas for project 0a302ca039794ab599996fcda417a1c6. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:15:43.283256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-1ae38162-04a0-49de-ba3f-51216c85ff93 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Getting quotas for user 42efd916cb4b4980a45199d8cc9a4389 and project 0a302ca039794ab599996fcda417a1c6. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:15:43.375480 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1ae38162-04a0-49de-ba3f-51216c85ff93 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.517695 Oct 14 03:15:43.376202 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 489/1011] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:15:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:16:12.614212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1909998062", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1759476879", "security_groups": [{"name": "tempest-secgroup-smoke-1563930920"}], "networks": [{"uuid": "71d337ac-bd81-450a-b927-c23c558a6c9e"}], "block_device_mapping_v2": [{"uuid": "ac07b7f5-6092-45f7-8b70-b9226ebfb989", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:12.624633 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:12.625279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=48 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:12.727837 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] validate_networks() for [('71d337ac-bd81-450a-b927-c23c558a6c9e', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:16:13.196169 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:16:13.196587 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:16:13.197059 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:16:13.197459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:16:13.197894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:16:13.206510 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:13.210355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:13.210355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:13.210355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:13.210355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:13.210753 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:13.224938 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Getting quotas for project 0a302ca039794ab599996fcda417a1c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:16:13.228811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Getting quotas for user 42efd916cb4b4980a45199d8cc9a4389 and project 0a302ca039794ab599996fcda417a1c6. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:16:13.285978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:16:13.288051 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac07b7f5-6092-45f7-8b70-b9226ebfb989',volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:16:13.743776 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2bed1da4-3cae-4314-b754-2fecba35f298 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.133710 Oct 14 03:16:13.744757 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 523/1012] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:16:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:16:13.754754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=4 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:13.759698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-009551aa-9db0-4e61-9c1f-372909b550df tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:13.760381 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-009551aa-9db0-4e61-9c1f-372909b550df tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:13.824415 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-009551aa-9db0-4e61-9c1f-372909b550df tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:13.828405 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-009551aa-9db0-4e61-9c1f-372909b550df tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1089 microversion: 2.1 time: 0.075075 Oct 14 03:16:13.829355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 490/1013] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:13 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:14.852285 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:14.853143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:14.859796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:14.860293 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:14.860727 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:14.861426 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:14.861919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:14.862368 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:14.922854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:14.930857 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fa960546-02a1-4912-bbd3-2ac0bee94aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1139 microversion: 2.1 time: 0.083164 Oct 14 03:16:14.942328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 524/1014] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:14 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:15.964082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:15.964786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:15.971947 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:15.972423 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:15.972923 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:15.973614 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:15.974111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:15.974532 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:16.035751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:16.043754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f7cffe3f-95ba-4bcf-8e0b-5397742735b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1187 microversion: 2.1 time: 0.084321 Oct 14 03:16:16.044380 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 491/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:15 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:17.066833 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:17.067492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:17.074679 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:17.075383 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:17.075976 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:17.076837 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:17.077702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:17.078076 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:17.245736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:17.253468 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b0dca27f-71fc-4a81-af27-abf720835bd4 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1273 microversion: 2.1 time: 0.190485 Oct 14 03:16:17.254147 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 525/1016] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:17 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:18.239812 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-5be9dd5c-9590-4e6c-a943-5ba9dfd1f68c req-8aae30ac-32d6-4295-be1d-c2e62a074d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7b2b6d-19a6-45e5-a1ad-731398a95ed0", "tag": "9022210d-e752-4633-9cb8-be36d1d5cd36"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:18.248323 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-5be9dd5c-9590-4e6c-a943-5ba9dfd1f68c req-8aae30ac-32d6-4295-be1d-c2e62a074d61 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:18.248893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-5be9dd5c-9590-4e6c-a943-5ba9dfd1f68c req-8aae30ac-32d6-4295-be1d-c2e62a074d61 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:18.249393 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-5be9dd5c-9590-4e6c-a943-5ba9dfd1f68c req-8aae30ac-32d6-4295-be1d-c2e62a074d61 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:18.261372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-5be9dd5c-9590-4e6c-a943-5ba9dfd1f68c req-8aae30ac-32d6-4295-be1d-c2e62a074d61 service nova] Creating event network-changed:9022210d-e752-4633-9cb8-be36d1d5cd36 for instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 on hv-cinder-80152 Oct 14 03:16:18.269619 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-5be9dd5c-9590-4e6c-a943-5ba9dfd1f68c req-8aae30ac-32d6-4295-be1d-c2e62a074d61 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037074 Oct 14 03:16:18.270264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 492/1017] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:16:18.276988 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:18.277604 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:18.284044 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:18.284520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:18.284953 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:18.285684 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:18.286163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:18.286582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:18.421656 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:18.429464 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d4891b7b-f094-42f5-a8b4-e730a90e52fd tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1273 microversion: 2.1 time: 0.156857 Oct 14 03:16:18.430530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 526/1018] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:18 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:19.452825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:19.453556 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:19.459681 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:19.460169 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:19.460607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:19.461817 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:19.462278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:19.462747 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:19.590707 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:19.598313 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ad18e530-5cef-455e-87c3-874459d0b38b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.150169 Oct 14 03:16:19.598898 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 493/1019] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:19 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:20.621785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:20.622487 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:20.629238 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:20.629781 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:20.630226 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:20.630966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:20.631414 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:20.631830 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:20.762881 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:20.770546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7e7d0290-add1-44b8-8c04-ebf933485bb1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.153446 Oct 14 03:16:20.771103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 527/1020] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:20 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:21.792953 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:21.793557 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:21.799919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:21.800395 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:21.800827 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:21.801506 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:21.801991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:21.802412 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:21.933174 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:21.940963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6e972cdc-346f-4aec-a5b8-7cda1f90527d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.151967 Oct 14 03:16:21.941518 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 494/1021] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:21 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:22.964114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:22.964726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:22.971172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:22.971681 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:22.972111 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:22.972828 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:22.973283 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:22.973717 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:23.103902 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:23.112125 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a4f5a938-d0c2-46b8-a41b-b1f117955129 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.152363 Oct 14 03:16:23.112948 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 528/1022] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:22 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:24.135577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:24.136054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:24.138608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:24.143480 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:24.143963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:24.144397 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:24.145160 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:24.146274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:24.146701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:24.279558 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:24.287272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0a0d97ac-aca5-44c4-a6fc-2552fb9dfb0c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.155731 Oct 14 03:16:24.287834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 495/1023] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:24 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:25.310312 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:25.311637 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:25.319923 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:25.320811 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=6 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:25.323079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:25.323879 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:25.324320 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:25.325328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:25.326124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:25.326775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:25.474573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:25.482866 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-325461c3-af88-4a39-ac06-79b6d42a9d15 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.177016 Oct 14 03:16:25.483436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 529/1024] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:25 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:26.505534 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:26.506174 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:26.513195 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:26.513717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:26.524738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:26.524738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:26.524738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:26.524738 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:26.664617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:26.672488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cb2ab77b-b2b0-4bb4-94b6-fee97c176a3e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.171028 Oct 14 03:16:26.673049 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 496/1025] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:26 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:27.695130 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:27.695774 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:27.702239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:27.702720 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:27.703363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:27.704053 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:27.704508 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:27.704939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:27.835924 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:27.844013 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-12205db5-fc62-49df-b329-af63e65a09e2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.152774 Oct 14 03:16:27.844573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 530/1026] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:27 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:28.866822 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:28.867441 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:28.873785 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:28.874295 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:28.874733 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:28.875426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:28.875890 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:28.876317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:29.007913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:29.016254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-35d29d3e-bd4d-4170-8875-290610be3261 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.153592 Oct 14 03:16:29.016823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 497/1027] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:28 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:30.039242 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:30.039899 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:30.046055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:30.046534 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:30.046972 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:30.047665 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:30.048152 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:30.048579 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:30.179566 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:30.187292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-fad5c8c2-28b7-456d-a77f-d2da8ff08aa0 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.151935 Oct 14 03:16:30.187861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 531/1028] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:30 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:31.210603 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:31.211267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:31.218363 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:31.218848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:31.219285 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:31.219975 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:31.220433 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:31.220893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:31.357613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:31.365431 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8b70c266-9bee-4177-9cc0-91823db2224d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.158757 Oct 14 03:16:31.366020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 498/1029] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:31 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:32.387712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:32.388328 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:32.394663 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:32.395099 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:32.395535 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:32.396221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:32.396674 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:32.397094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:32.526454 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:32.534161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8b09ddd8-e706-4488-89be-27f5bad5556d tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.150485 Oct 14 03:16:32.534719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 532/1030] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:32 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:33.557040 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:33.558193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:33.564145 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:33.567290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:33.567290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:33.567290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:33.567290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:33.567676 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:33.697115 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:33.705708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-faaa867c-172a-49e4-b348-5fcc46cccd2a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.152508 Oct 14 03:16:33.706299 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 499/1031] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:33 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:33.813665 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-49ceb27a-ba8b-41d5-b216-e3dd70713e6d req-a61d187a-143c-4096-82d0-b031c7dd8be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7b2b6d-19a6-45e5-a1ad-731398a95ed0", "name": "network-vif-plugged", "status": "completed", "tag": "9022210d-e752-4633-9cb8-be36d1d5cd36"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:33.825164 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-49ceb27a-ba8b-41d5-b216-e3dd70713e6d req-a61d187a-143c-4096-82d0-b031c7dd8be5 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:33.825642 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-49ceb27a-ba8b-41d5-b216-e3dd70713e6d req-a61d187a-143c-4096-82d0-b031c7dd8be5 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:33.826101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-49ceb27a-ba8b-41d5-b216-e3dd70713e6d req-a61d187a-143c-4096-82d0-b031c7dd8be5 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:33.838634 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-49ceb27a-ba8b-41d5-b216-e3dd70713e6d req-a61d187a-143c-4096-82d0-b031c7dd8be5 service nova] Creating event network-vif-plugged:9022210d-e752-4633-9cb8-be36d1d5cd36 for instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 on hv-cinder-80152 Oct 14 03:16:33.843743 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-49ceb27a-ba8b-41d5-b216-e3dd70713e6d req-a61d187a-143c-4096-82d0-b031c7dd8be5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033927 Oct 14 03:16:33.844326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 533/1032] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:16:34.729703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:34.730351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:34.736988 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:34.737474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:34.738196 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:34.738890 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:34.739346 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:34.739768 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:34.868964 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:34.877476 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e5e1c18e-2fee-480d-b61b-fe671b2fa3d7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1261 microversion: 2.1 time: 0.151652 Oct 14 03:16:34.879901 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 500/1033] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:34 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:16:35.902770 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:35.903497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:35.909662 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:35.910184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:35.910624 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:35.911303 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:35.911756 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:35.912175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:36.072453 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:36.080946 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cdd47068-4c9a-4f9f-9fd0-2fe8b2265736 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1445 microversion: 2.1 time: 0.183569 Oct 14 03:16:36.081525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 534/1034] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:35 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:16:36.104170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:16:36.104819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:16:36.111786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:36.112536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:36.113410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:36.114328 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:36.115007 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:36.115632 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:36.255339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:16:36.263680 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8a0d3fdc-dac6-417a-9f69-66193f5b78b8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1445 microversion: 2.1 time: 0.163388 Oct 14 03:16:36.264249 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 501/1035] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:16:36 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:16:38.395542 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-cd32f3f9-8a08-415e-9748-429d47d88d5f req-fe74e501-e68f-44fd-9a93-cea0a7c48924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7b2b6d-19a6-45e5-a1ad-731398a95ed0", "tag": "9022210d-e752-4633-9cb8-be36d1d5cd36"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:16:38.405171 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-cd32f3f9-8a08-415e-9748-429d47d88d5f req-fe74e501-e68f-44fd-9a93-cea0a7c48924 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:16:38.405651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-cd32f3f9-8a08-415e-9748-429d47d88d5f req-fe74e501-e68f-44fd-9a93-cea0a7c48924 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:16:38.406119 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-cd32f3f9-8a08-415e-9748-429d47d88d5f req-fe74e501-e68f-44fd-9a93-cea0a7c48924 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:16:38.418124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-cd32f3f9-8a08-415e-9748-429d47d88d5f req-fe74e501-e68f-44fd-9a93-cea0a7c48924 service nova] Creating event network-changed:9022210d-e752-4633-9cb8-be36d1d5cd36 for instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 on hv-cinder-80152 Oct 14 03:16:38.423200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-cd32f3f9-8a08-415e-9748-429d47d88d5f req-fe74e501-e68f-44fd-9a93-cea0a7c48924 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031302 Oct 14 03:16:38.424326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 535/1036] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:17:37.904771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:37.905741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=62 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:37.909882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-13868dd5-daf1-4665-a67a-26ca32b29d13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Action: 'create', calling method: .version_select at 0x7f2beb760f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1706297826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD+1z/DDbCnB8W80g9geF5yXvIPE0TjXIg1FF3HWIW7c2a8etkcE+7jJysZjWQy9Ai/wjawlXh0nacIaZ03/dTOE+cXZ90M6/5VQMmYdbzSLQv1LHIkGPzsP3nMrGPfOw=="}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:17:37.924630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-13868dd5-daf1-4665-a67a-26ca32b29d13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Getting quotas for project f2c0270c3f82423ea62db21e22ac86bd. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:17:37.928384 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-13868dd5-daf1-4665-a67a-26ca32b29d13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Getting quotas for user ca9545f301e24e579903df7f87337f8e and project f2c0270c3f82423ea62db21e22ac86bd. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:17:37.999592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-13868dd5-daf1-4665-a67a-26ca32b29d13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.096165 Oct 14 03:17:38.000117 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 502/1037] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:17:37 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:17:38.048248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:38.048995 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=66 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:38.053004 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-925618193", "imageRef": "e2daf4e9-62be-4a60-9305-daec7a0d3ecf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1706297826", "networks": [{"uuid": "e3839baf-b0cf-4ade-9ba8-3b5f5df4328e"}]}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:17:38.210925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] validate_networks() for [('e3839baf-b0cf-4ade-9ba8-3b5f5df4328e', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:17:38.567371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:17:38.567777 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:17:38.568399 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:17:38.568810 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:17:38.569224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:17:38.578017 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:38.578498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:38.578929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:38.579651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:38.580103 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:38.580523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:38.597445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Getting quotas for project f2c0270c3f82423ea62db21e22ac86bd. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:17:38.601385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Getting quotas for user ca9545f301e24e579903df7f87337f8e and project f2c0270c3f82423ea62db21e22ac86bd. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:17:38.612912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:17:38.615516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e2daf4e9-62be-4a60-9305-daec7a0d3ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:17:38.740624 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3afbcff2-4bc6-41f3-9bda-95c42af58777 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693911 Oct 14 03:17:38.741267 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 536/1038] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:17:38.752825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b8e4792e-7159-4886-9b5c-06030c476e0f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:38.754100 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b8e4792e-7159-4886-9b5c-06030c476e0f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:38.914868 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b8e4792e-7159-4886-9b5c-06030c476e0f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:38.921295 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b8e4792e-7159-4886-9b5c-06030c476e0f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1258 microversion: 2.1 time: 0.172955 Oct 14 03:17:38.921881 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 503/1039] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:38 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:17:39.944951 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:39.945565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:39.952474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:39.952955 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:39.953387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:39.954107 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:39.954561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:39.954984 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:40.015108 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:40.023041 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a6d5ff2e-62a0-49c1-bd30-e51750f5e6c7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1262 microversion: 2.1 time: 0.082487 Oct 14 03:17:40.023608 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 537/1040] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:39 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:41.046281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:41.046900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:41.055901 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:41.056388 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:41.056823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:41.057527 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:41.058082 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:41.058512 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:41.119850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:41.128146 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ce6fcaac-968e-4112-9030-0f217f170a88 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1310 microversion: 2.1 time: 0.085873 Oct 14 03:17:41.128713 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 504/1041] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:41 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:42.155334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:42.157673 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:42.163474 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:42.163961 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:42.164396 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:42.165099 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:42.165549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:42.166095 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:42.319093 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:42.329520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d9793426-cfaf-4f6c-89a2-f037c7a8e01d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.177352 Oct 14 03:17:42.345482 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 538/1042] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:42 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:43.204613 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-6919200c-4bb5-4dbd-ac8e-917647966df4 req-156eb55b-fa05-4c78-9451-1ac1b53b5ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60599b5-5691-4ad2-ac62-6cc7744f974a", "tag": "58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:17:43.220866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6919200c-4bb5-4dbd-ac8e-917647966df4 req-156eb55b-fa05-4c78-9451-1ac1b53b5ba0 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:43.221359 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6919200c-4bb5-4dbd-ac8e-917647966df4 req-156eb55b-fa05-4c78-9451-1ac1b53b5ba0 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:43.222020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6919200c-4bb5-4dbd-ac8e-917647966df4 req-156eb55b-fa05-4c78-9451-1ac1b53b5ba0 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:43.235648 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-6919200c-4bb5-4dbd-ac8e-917647966df4 req-156eb55b-fa05-4c78-9451-1ac1b53b5ba0 service nova] Creating event network-changed:58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 for instance d60599b5-5691-4ad2-ac62-6cc7744f974a on hv-cinder-80152 Oct 14 03:17:43.241225 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-6919200c-4bb5-4dbd-ac8e-917647966df4 req-156eb55b-fa05-4c78-9451-1ac1b53b5ba0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041424 Oct 14 03:17:43.241848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 505/1043] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:17:43.356305 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:43.357162 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:43.364300 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:43.364800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:43.365214 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:43.365945 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:43.366403 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:43.366827 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:43.508085 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:43.515649 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4cd55e94-c474-43e6-a92b-0b2abf94bd4b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.163291 Oct 14 03:17:43.516229 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 539/1044] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:43 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:44.539260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:44.540022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:44.546193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:44.546675 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:44.547111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:44.547794 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:44.548245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:44.548664 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:44.687034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:44.695178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e754eb42-556e-4f42-bf3c-8cad3f211f13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.160563 Oct 14 03:17:44.701906 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 506/1045] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:44 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:45.718649 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:45.719261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:45.726316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:45.726799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:45.727230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:45.727925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:45.728371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:45.728803 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:45.865197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:45.873445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bbfc97fe-a2d5-461e-8eb1-e01528b79155 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.158483 Oct 14 03:17:45.874060 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 540/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:45 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:46.896577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:46.897259 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:46.904156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:46.904646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:46.905084 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:46.905808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:46.906268 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:46.906695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:47.049678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:47.057950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-da192f97-3fa8-4ae2-85be-2d07cbee8947 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.165292 Oct 14 03:17:47.059014 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 507/1047] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:46 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:48.081577 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:48.082378 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:48.104795 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:48.105298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:48.105741 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:48.106480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:48.106948 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:48.107371 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:48.252502 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:48.260322 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b85fb257-359e-489d-9bad-84cd35663456 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.183107 Oct 14 03:17:48.261194 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 541/1048] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:48 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:49.287164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:49.288757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:49.292016 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:49.298315 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:49.298923 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:49.299503 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:49.300272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:49.300844 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:49.301348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:49.439869 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:49.447569 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e9dbc92d-ef75-4423-bf9c-816c5b5074a8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.166679 Oct 14 03:17:49.448121 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 508/1049] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:49 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:50.470671 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:50.471287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:50.473094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:50.473787 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=6 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:50.478951 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:50.479440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:50.479876 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:50.480567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:50.481023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:50.481511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:50.606479 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:50.615759 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bbd1abde-abaf-4399-84c0-730283f6220b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.148998 Oct 14 03:17:50.616343 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 542/1050] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:50 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:51.640087 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:51.640722 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:51.647540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:51.648018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:51.648443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:51.649117 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:51.649567 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:51.650006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:51.780733 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:51.789116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c2a3b28a-9340-4230-8f07-40e911643823 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.152861 Oct 14 03:17:51.789682 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 509/1051] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:51 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:52.812403 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:52.813040 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:52.815794 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 03:17:52.815929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Fri Oct 14 03:17:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a (ip 10.222.0.39) !!! Oct 14 03:17:52.822922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:52.823405 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:52.823835 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:52.824519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:52.824968 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:52.825384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:52.950164 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:52.957746 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9747646d-4712-4e45-ad4c-80151a5e759f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.149200 Oct 14 03:17:52.958326 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 543/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:52 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:53.981088 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:53.981850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:53.989585 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:53.990104 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:53.990541 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:53.991266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:53.991715 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:53.992163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:54.127310 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:54.131817 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bc8638e1-e0ce-4724-94c5-3a79cddc515e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.154674 Oct 14 03:17:54.132392 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 510/1053] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:53 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:55.154173 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:55.154787 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:55.161653 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:55.162165 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:55.162602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:55.163290 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:55.163772 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:55.164195 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:55.288391 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:55.295912 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cada100d-d31e-440c-be5a-c15ce9be3c08 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.145773 Oct 14 03:17:55.296473 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 544/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:55 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:56.135562 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-42da03da-bdf9-475b-b158-59661f92b507 req-5e938758-f79a-4cea-b667-f5a78ed641d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60599b5-5691-4ad2-ac62-6cc7744f974a", "name": "network-vif-plugged", "status": "completed", "tag": "58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:17:56.146485 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-42da03da-bdf9-475b-b158-59661f92b507 req-5e938758-f79a-4cea-b667-f5a78ed641d8 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:56.146957 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-42da03da-bdf9-475b-b158-59661f92b507 req-5e938758-f79a-4cea-b667-f5a78ed641d8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:56.147378 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-42da03da-bdf9-475b-b158-59661f92b507 req-5e938758-f79a-4cea-b667-f5a78ed641d8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:56.159345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-42da03da-bdf9-475b-b158-59661f92b507 req-5e938758-f79a-4cea-b667-f5a78ed641d8 service nova] Creating event network-vif-plugged:58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 for instance d60599b5-5691-4ad2-ac62-6cc7744f974a on hv-cinder-80152 Oct 14 03:17:56.164317 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-42da03da-bdf9-475b-b158-59661f92b507 req-5e938758-f79a-4cea-b667-f5a78ed641d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032716 Oct 14 03:17:56.164900 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 511/1055] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:17:56.319405 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:56.320068 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:56.326529 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:56.333925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:56.333925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:56.333925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:56.333925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:56.334318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:56.456189 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:56.463913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-07f26dac-2fcb-4bc5-b35e-455736b837e3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.148631 Oct 14 03:17:56.464485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 545/1056] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:56 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:57.487723 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:57.488423 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:57.495200 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:57.495672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:57.496101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:57.496776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:57.497220 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:57.497636 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:57.639527 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:57.647357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c377629d-d9dc-4612-8aac-8164626c5928 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1358 microversion: 2.1 time: 0.164210 Oct 14 03:17:57.648155 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 512/1057] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:57 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:58.670462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:58.670983 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:58.676869 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:58.677353 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:58.677812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:58.678502 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:58.678959 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:58.679383 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:58.803524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:58.811209 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2b6b6ee8-81fc-4f43-b2d2-6a3d291f448d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1548 microversion: 2.1 time: 0.144825 Oct 14 03:17:58.811771 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 546/1058] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:58 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:58.834144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:58.834757 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:58.840991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:58.841469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:58.841940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:58.842628 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:58.843079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:58.843497 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:58.971844 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:58.979445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9360fd63-ceb4-405f-8f5e-791acb2687fd tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1548 microversion: 2.1 time: 0.149720 Oct 14 03:17:58.979994 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 513/1059] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:58 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:17:59.001489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:59.007036 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:59.007814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Searching by: {'deleted': False, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd'} {{(pid=119284) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 14 03:17:59.014699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:59.015179 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:59.015607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:59.016329 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:59.016778 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:59.017199 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:59.105114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.multi_cell_list [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119284) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 14 03:17:59.196432 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-877797fd-b52b-40d4-8013-d2b6352696d2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.198607 Oct 14 03:17:59.196934 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 547/1060] 10.222.0.39 () {58 vars in 1125 bytes} [Fri Oct 14 03:17:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:17:59.208698 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:17:59.209303 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:17:59.215114 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:59.215591 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:59.216017 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:59.216697 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:17:59.217140 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:17:59.217554 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:17:59.342128 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:17:59.349874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9e4f8ee3-4bf8-4442-bd09-1b24b50d3892 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1548 microversion: 2.1 time: 0.145232 Oct 14 03:17:59.350432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 514/1061] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:17:59 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:01.258514 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd3e81a3-f0d5-4b49-87b9-ee906ec8d421"}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:18:01.260844 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:01.267213 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:01.267694 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:01.268133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:01.269318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:01.269793 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:01.270215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:02.036268 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c5b52333-4eb0-4ed1-9f40-75dc856070a9 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "POST /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781608 Oct 14 03:18:02.036871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 548/1062] 10.222.0.39 () {60 vars in 1323 bytes} [Fri Oct 14 03:18:01 2022] POST /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:18:09.614498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:09.615111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:09.617334 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:09.618131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=58 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:09.622751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:09.623231 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:09.623667 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:09.624363 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:09.624801 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:09.625222 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:09.752828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:09.761474 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-669e5d4e-7dae-4ee4-b68d-f9725477d51b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1594 microversion: 2.1 time: 0.151699 Oct 14 03:18:09.762053 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 515/1063] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:09 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:11.648030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:11.649062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:11.717585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-28a9b394-4ef1-4c65-804a-b9af7c79c94c req-c8d727d4-4b01-4558-98d6-9123094cf638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60599b5-5691-4ad2-ac62-6cc7744f974a", "tag": "58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:18:11.727765 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-28a9b394-4ef1-4c65-804a-b9af7c79c94c req-c8d727d4-4b01-4558-98d6-9123094cf638 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:11.733019 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-28a9b394-4ef1-4c65-804a-b9af7c79c94c req-c8d727d4-4b01-4558-98d6-9123094cf638 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:11.733019 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-28a9b394-4ef1-4c65-804a-b9af7c79c94c req-c8d727d4-4b01-4558-98d6-9123094cf638 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:11.733019 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:11.740057 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-28a9b394-4ef1-4c65-804a-b9af7c79c94c req-c8d727d4-4b01-4558-98d6-9123094cf638 service nova] Creating event network-changed:58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 for instance d60599b5-5691-4ad2-ac62-6cc7744f974a on hv-cinder-80152 Oct 14 03:18:11.745513 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-28a9b394-4ef1-4c65-804a-b9af7c79c94c req-c8d727d4-4b01-4558-98d6-9123094cf638 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098978 Oct 14 03:18:11.746204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 549/1064] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:18:14.065189 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-852818805"}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:18:14.065780 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:14.072249 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.072730 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.073167 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.073880 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.074339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.074761 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.199391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.network.security_group_api [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Adding security group 43a1a7e4-27e3-4036-86a0-0fe7cb60c822 to port 58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 Oct 14 03:18:14.578311 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ade83169-39ac-435e-aba1-4659c407c41f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "POST /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/action" status: 202 len: 0 microversion: 2.1 time: 0.516938 Oct 14 03:18:14.578939 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 516/1065] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:18:14 2022] POST /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:18:14.587718 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:14.588483 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:14.596940 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.598112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.598112 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.599094 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.599487 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.600010 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.655865 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-169ff0ba-f8f1-45e8-bf18-329e5e466da8 req-fd118a32-6acb-4137-940f-49c697c5db21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60599b5-5691-4ad2-ac62-6cc7744f974a", "tag": "58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:18:14.666192 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-169ff0ba-f8f1-45e8-bf18-329e5e466da8 req-fd118a32-6acb-4137-940f-49c697c5db21 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:14.666847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-169ff0ba-f8f1-45e8-bf18-329e5e466da8 req-fd118a32-6acb-4137-940f-49c697c5db21 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:14.667407 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-169ff0ba-f8f1-45e8-bf18-329e5e466da8 req-fd118a32-6acb-4137-940f-49c697c5db21 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:14.679818 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-169ff0ba-f8f1-45e8-bf18-329e5e466da8 req-fd118a32-6acb-4137-940f-49c697c5db21 service nova] Creating event network-changed:58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 for instance d60599b5-5691-4ad2-ac62-6cc7744f974a on hv-cinder-80152 Oct 14 03:18:14.684852 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-169ff0ba-f8f1-45e8-bf18-329e5e466da8 req-fd118a32-6acb-4137-940f-49c697c5db21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100439 Oct 14 03:18:14.685822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 550/1066] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:18:15.001445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:15.010190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-56defad6-7f01-446b-8bb4-7d29f26a87ee tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1758 microversion: 2.1 time: 0.426154 Oct 14 03:18:15.014916 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 517/1067] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:14 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1758 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:37.700493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=4 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:37.701236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:37.705367 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:18:37.707719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:37.713658 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:37.714166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:37.714600 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:37.715285 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:37.715735 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:37.716154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:37.888890 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3dbc7d18-8e46-424e-896f-ab5baea97b33 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "POST /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/action" status: 202 len: 0 microversion: 2.1 time: 0.189480 Oct 14 03:18:37.889777 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 551/1068] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:18:37 2022] POST /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:18:37.898138 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:37.898781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:37.900898 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:37.901564 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=16 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:37.906337 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:37.906822 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:37.907256 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:37.907951 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:37.908405 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:37.908827 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:38.053961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:38.062348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f73bd739-c5d0-4dad-b295-c01b0231e60d tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1750 microversion: 2.1 time: 0.168269 Oct 14 03:18:38.062910 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 518/1069] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:37 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:39.086256 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:39.086954 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:39.093449 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:39.093974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:39.094414 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:39.095104 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:39.095560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:39.095979 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:39.234026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:39.243024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e4dfc856-d21f-4137-9018-df4ae0922d93 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.161027 Oct 14 03:18:39.243574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 552/1070] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:39 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:40.267033 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:40.267552 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:40.274599 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:40.275075 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:40.275502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:40.276179 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:40.276624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:40.277039 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:40.420468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:40.428878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8b01d937-449e-478c-bacc-4a977763ed53 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.165776 Oct 14 03:18:40.429444 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 519/1071] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:40 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:41.451582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:41.452234 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:41.458705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:41.459184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:41.459617 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:41.460309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:41.460760 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:41.461188 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:41.597317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:41.605645 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-75379489-87d3-45bd-832d-9a55287054a2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.157894 Oct 14 03:18:41.610816 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 553/1072] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:41 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:42.630470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:42.631148 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:42.637531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:42.638050 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:42.638489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:42.639183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:42.639638 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:42.640086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:42.780445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:42.789136 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6c922cbc-0aef-43cb-918d-7b2cf8038701 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.163265 Oct 14 03:18:42.789689 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 520/1073] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:42 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:43.812612 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:43.813222 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:43.820159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:43.820637 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:43.821072 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:43.821780 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:43.822233 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:43.822654 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:43.962524 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:43.970643 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-708e5e47-f78a-4ec1-b42b-136dd33901f5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.161871 Oct 14 03:18:43.971203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 554/1074] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:43 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:44.993897 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:44.994499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:45.000760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:45.001232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:45.001660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:45.002374 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:45.002824 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:45.003239 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:45.140533 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:45.149272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-df0cc90e-8dea-4c49-9f18-cf6bf1623f41 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.159222 Oct 14 03:18:45.149845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 521/1075] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:44 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:46.171545 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:46.172159 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:46.179206 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:46.179683 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:46.180116 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:46.180799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:46.181248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:46.181699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:46.321728 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:46.329773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-50f668dc-9169-49cb-a765-52899879a97c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.162038 Oct 14 03:18:46.330334 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 555/1076] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:46 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:47.353110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:47.353779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:47.360341 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:47.360825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:47.361259 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:47.361978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:47.362437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:47.362863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:47.499020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:47.507631 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ca582092-af5a-4b63-aa2d-35c8d9971ee5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.158383 Oct 14 03:18:47.508195 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 522/1077] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:47 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:48.532073 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:48.532686 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:48.539673 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:48.540152 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:48.540595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:48.541278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:48.541726 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:48.542170 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:48.684561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:48.692818 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-59ee374d-a881-4ae4-af05-039ac9912056 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.164580 Oct 14 03:18:48.693377 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 556/1078] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:48 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:49.715600 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:49.716217 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:49.723468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:49.724005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:49.724443 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:49.725136 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:49.725588 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:49.726042 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:49.864990 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:49.873196 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0ddb1b38-f66a-4998-a178-9d47fd781da7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.161494 Oct 14 03:18:49.873775 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 523/1079] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:49 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:50.896425 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:50.897081 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:50.903376 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:50.903859 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:50.904291 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:50.904981 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:50.905427 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:50.905872 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:51.047486 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:51.056258 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6543ead0-6eaa-4be7-ab5d-292151f8659b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.163726 Oct 14 03:18:51.056820 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 557/1080] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:50 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:52.079220 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:52.079838 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:52.086904 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:52.087391 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:52.087831 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:52.088521 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:52.088975 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:52.089400 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:52.226036 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:52.234183 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4acc00fa-69d5-479d-9767-52b02f3d8c4e tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.158785 Oct 14 03:18:52.234751 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 524/1081] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:52 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:53.257751 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:53.258401 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:53.264768 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:53.265190 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:53.265623 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:53.266345 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:53.266798 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:53.267215 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:53.404845 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:53.412894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6bc26515-dbad-4eeb-b1f0-185f97b8ec13 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.159001 Oct 14 03:18:53.413457 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 558/1082] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:53 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:54.436127 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:54.436767 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:54.443432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:54.443912 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:54.444366 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:54.445050 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:54.445500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:54.445960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:54.587513 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:54.595707 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6a8c10ec-321a-4cf4-8605-429bcac6b72c tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1755 microversion: 2.1 time: 0.163485 Oct 14 03:18:54.596267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 525/1083] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:54 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:55.619574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:55.620184 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:55.626622 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:55.627101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:55.627536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:55.628221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:55.628700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:55.629218 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:55.766498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:55.774578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-cd37856b-4b28-4c15-8ecb-4b793b03b1b3 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1758 microversion: 2.1 time: 0.158841 Oct 14 03:18:55.775138 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 559/1084] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:55 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:58.416540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:18:58.417098 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:58.423555 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:58.424029 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:58.424958 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:58.425637 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:58.426114 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:58.426531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:58.448774 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lazy-loading 'flavor' on Instance uuid fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:18:58.740647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b22a772f-8be0-45e6-839c-495c26be1d4b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "POST /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0/action" status: 202 len: 0 microversion: 2.1 time: 0.327713 Oct 14 03:18:58.741172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 526/1085] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:18:58 2022] POST /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:18:58.750226 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:58.751196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:58.757092 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:58.762480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:58.762480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:58.762480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:58.762480 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:58.762878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:58.893419 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:18:58.901309 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2a580de8-ccfb-4b0b-8f53-b6e66c6362e8 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.155720 Oct 14 03:18:58.901899 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 560/1086] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:58 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:18:59.926085 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:18:59.926786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:18:59.932848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:59.933329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:59.933779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:18:59.934481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:18:59.934933 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:18:59.935357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:00.066977 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:00.074692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c346023e-ae11-47c3-adba-6101c239d597 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.153982 Oct 14 03:19:00.075258 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 527/1087] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:18:59 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:01.097925 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:01.098539 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:01.104943 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:01.105424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:01.105888 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:01.106578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:01.107036 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:01.107492 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:01.234122 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:01.242409 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4ca6395a-e3dd-4f73-8891-21f02e2fcd48 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.148405 Oct 14 03:19:01.242966 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 561/1088] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:01 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:02.265992 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:02.266516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:02.273454 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:02.273987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:02.274424 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:02.275116 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:02.275568 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:02.275993 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:02.408122 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:02.418170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e99bca45-24f3-41ea-bf4d-9b56c3806f55 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.153725 Oct 14 03:19:02.418170 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 528/1089] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:02 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:03.438142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:03.438785 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:03.445259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:03.445736 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:03.446204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:03.446887 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:03.447339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:03.447760 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:03.573598 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:03.581809 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-61a44019-4c91-48d8-8c43-c7be63d374da tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.147448 Oct 14 03:19:03.582386 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 562/1090] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:03 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:04.605161 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:04.607776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:04.612232 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:04.612711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:04.613143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:04.613887 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:04.614843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:04.615274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:04.745752 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:04.753693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-63b2f03b-3e80-45ee-a42d-666a4d1a0374 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.152601 Oct 14 03:19:04.754294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 529/1091] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:04 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:05.777224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:05.777883 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:05.784196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:05.784680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:05.785113 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:05.785830 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:05.786286 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:05.786709 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:05.914587 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:05.922316 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ad2df485-2907-4e91-aa53-1d655d3f7e1f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.148784 Oct 14 03:19:05.922878 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 563/1092] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:05 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:06.945604 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:06.946302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:06.952633 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:06.953130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:06.953556 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:06.954262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:06.954708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:06.955124 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:07.086422 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:07.094054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ebb29201-f5c0-4354-a92c-21a90ab6fb8a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.152279 Oct 14 03:19:07.094616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 530/1093] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:06 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:08.117594 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:08.118266 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:08.120656 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=27 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:19:08.125299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:08.125840 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:08.126284 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:08.126990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:08.128062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:08.128493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:08.132439 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:19:08.257991 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:08.265537 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-df53b77c-2d28-4679-8a7b-86fee746ac77 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.152024 Oct 14 03:19:08.266118 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 564/1094] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:08 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:09.288492 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:09.289140 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:09.291573 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=27 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:19:09.296194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:09.296673 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:09.297105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:09.297823 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:09.298289 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:09.298710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:09.302781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:19:09.432059 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:09.440403 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-65e36c66-fb2c-4e15-9293-e30bb96fa69c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.155210 Oct 14 03:19:09.440979 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 531/1095] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:09 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:10.463864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:10.464469 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:10.471674 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:10.472170 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:10.472602 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:10.473278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:10.473724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:10.474226 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:10.604820 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:10.612483 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-badf80dc-b5e7-472c-820d-d8e231e43105 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.152809 Oct 14 03:19:10.613045 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 565/1096] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:10 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:11.638459 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:11.638459 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:11.643085 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:11.643565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:11.643997 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:11.644690 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:11.645144 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:11.645566 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:11.775270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:11.783845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-344d2ead-7d3c-4028-8982-416290f4a204 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.151185 Oct 14 03:19:11.784411 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 532/1097] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:11 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:12.806415 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:12.807096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:12.813489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:12.814005 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:12.814434 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:12.815117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:12.815567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:12.815983 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:12.946058 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:12.953659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-5ce69abf-b708-4cef-bb24-e3dd1f9e1309 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1571 microversion: 2.1 time: 0.151078 Oct 14 03:19:12.954241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 566/1098] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:12 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:12.976505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:19:12.977105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:12.983555 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:12.984044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:12.984484 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:12.985178 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:12.985635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:12.986090 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:13.014845 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119283) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 03:19:13.301813 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [8c89ecda-fc1f-4a7a-8a1d-3bc6fe1ac9c5] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 14 03:19:14.310541 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO oslo.messaging._drivers.impl_rabbit [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [8c89ecda-fc1f-4a7a-8a1d-3bc6fe1ac9c5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60114. Oct 14 03:19:14.313516 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-1697a311-61c5-4b80-b3c6-3278113ac1ef req-2bdfb172-534b-440b-91c8-c83212cfc203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7b2b6d-19a6-45e5-a1ad-731398a95ed0", "name": "network-vif-unplugged", "status": "completed", "tag": "9022210d-e752-4633-9cb8-be36d1d5cd36"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:19:14.314184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a37e86dd-3c42-440b-971a-251d29406cb2 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "POST /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0/action" status: 202 len: 0 microversion: 2.1 time: 1.341478 Oct 14 03:19:14.314794 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 533/1099] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:19:12 2022] POST /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0/action => generated 0 bytes in 1343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:19:14.322030 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1697a311-61c5-4b80-b3c6-3278113ac1ef req-2bdfb172-534b-440b-91c8-c83212cfc203 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:14.322761 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1697a311-61c5-4b80-b3c6-3278113ac1ef req-2bdfb172-534b-440b-91c8-c83212cfc203 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:14.322978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:14.323191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1697a311-61c5-4b80-b3c6-3278113ac1ef req-2bdfb172-534b-440b-91c8-c83212cfc203 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:14.323551 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:14.329743 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:14.330329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:14.330775 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:14.331470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:14.332279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:14.332991 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:14.334629 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.compute.server_external_events [req-1697a311-61c5-4b80-b3c6-3278113ac1ef req-2bdfb172-534b-440b-91c8-c83212cfc203 service nova] Unable to find a host for instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0. Dropping event network-vif-unplugged {{(pid=119284) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 14 03:19:14.338843 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-1697a311-61c5-4b80-b3c6-3278113ac1ef req-2bdfb172-534b-440b-91c8-c83212cfc203 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.083266 Oct 14 03:19:14.338843 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 567/1100] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 14 03:19:14.473000 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:14.480739 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b4e07b23-8bb1-4270-b087-bbe5b5f33c6f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1519 microversion: 2.1 time: 0.161858 Oct 14 03:19:14.481301 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 534/1101] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:14 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:15.503163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:15.503775 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:15.510174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:15.510659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:15.511091 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:15.511777 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:15.512235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:15.512653 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:15.640690 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:15.649125 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-853bca53-4870-410a-bf3c-4644778d07ac tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1519 microversion: 2.1 time: 0.149837 Oct 14 03:19:15.649689 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 568/1102] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:15 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:16.672847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:16.673451 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:16.680595 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:16.681073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:16.681501 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:16.682215 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:16.682669 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:16.683085 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:16.812715 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:16.820331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e623c0ad-72f7-4dcc-b03c-51c0001f3c4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1519 microversion: 2.1 time: 0.151326 Oct 14 03:19:16.820909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 535/1103] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:16 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:17.843425 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:17.844027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:17.850426 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:17.850906 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:17.851341 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:17.852026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:17.852482 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:17.852921 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:17.978441 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:17.986018 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3c432053-6b2a-433e-85a9-81497d5cd356 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1519 microversion: 2.1 time: 0.146449 Oct 14 03:19:17.986582 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 569/1104] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:17 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:19.009847 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:19.010466 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:19.016768 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:19.017242 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:19.017676 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:19.018383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:19.018829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:19.019242 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:19.154536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:19.162259 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-25a68d24-1f5f-4897-b1e4-f2f516396148 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1519 microversion: 2.1 time: 0.156247 Oct 14 03:19:19.162887 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 536/1105] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:19 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:20.185834 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:20.186381 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:20.194172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:20.194648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:20.195082 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:20.195766 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:20.196212 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:20.196624 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:20.327175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:20.335987 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f5ca8dcb-f191-4663-bce2-800e1e8e2c09 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1521 microversion: 2.1 time: 0.154094 Oct 14 03:19:20.337249 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 570/1106] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:20 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:21.359062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:21.359700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:21.366372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:21.371748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:21.371748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:21.371748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:21.371748 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:21.372130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:21.498437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:21.506274 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c02d490d-7362-4336-addd-a53d241a2898 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.151095 Oct 14 03:19:21.506830 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 537/1107] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:21 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:22.528926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:22.529561 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:22.536028 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:22.536580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:22.537022 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:22.537715 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:22.538196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:22.538619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:22.666004 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:22.673874 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-25806398-8be7-4107-89b2-fa2b29c0d572 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.148792 Oct 14 03:19:22.674472 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 571/1108] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:22 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:23.698102 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:23.698715 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:23.705325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:23.705833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:23.706275 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:23.706968 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:23.707426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:23.707848 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:23.834025 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:23.841615 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e9a4fd95-d682-49ad-a540-372f562ee931 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.147783 Oct 14 03:19:23.842201 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 538/1109] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:23 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:24.865287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:24.865969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:24.872612 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:24.873097 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:24.873536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:24.874265 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:24.874720 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:24.875148 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:25.005851 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:25.013555 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e203a30c-4bd1-4f8c-ae6a-3d1463350964 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.153034 Oct 14 03:19:25.014143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 572/1110] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:24 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:26.035876 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:26.036490 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:26.043162 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:26.043644 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:26.044076 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:26.044761 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:26.045214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:26.045635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:26.177176 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:26.185726 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-59e6e4b1-74c1-475e-9f7a-3d2abb1dd0a1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.153713 Oct 14 03:19:26.186852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 539/1111] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:26 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:27.209797 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:27.210367 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:27.216651 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:27.217136 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:27.217569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:27.218275 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:27.218728 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:27.219143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:27.348463 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:27.356174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c4dbda0c-f42b-4963-9e9d-3d956591d753 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.150974 Oct 14 03:19:27.356730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 573/1112] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:27 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:28.380531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:28.381129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:28.387634 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:28.388113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:28.388544 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:28.389228 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:28.389672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:28.390111 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:28.523294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:28.531130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1d0e9919-d79e-4ddb-a671-76f116b43363 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.154549 Oct 14 03:19:28.531705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 540/1113] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:28 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:28.616277 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-852818805"}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:19:28.616808 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:28.622901 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:28.623374 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:28.623801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:28.624485 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:28.624935 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:28.625354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:28.748892 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.network.security_group_api [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Removing security group 43a1a7e4-27e3-4036-86a0-0fe7cb60c822 from port 58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 Oct 14 03:19:29.108528 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6a0b5fe3-6e2e-4191-8fb1-43a5d50d1cd7 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "POST /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/action" status: 202 len: 0 microversion: 2.1 time: 0.496475 Oct 14 03:19:29.109128 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 574/1114] 10.222.0.39 () {60 vars in 1278 bytes} [Fri Oct 14 03:19:28 2022] POST /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:19:29.119695 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-da91afc8-56d1-417b-a3bf-b3bc9c00bb17 req-44f41f60-cd97-4f85-93fe-016ac4dc3386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60599b5-5691-4ad2-ac62-6cc7744f974a", "tag": "58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:19:29.130640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-da91afc8-56d1-417b-a3bf-b3bc9c00bb17 req-44f41f60-cd97-4f85-93fe-016ac4dc3386 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:29.131158 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-da91afc8-56d1-417b-a3bf-b3bc9c00bb17 req-44f41f60-cd97-4f85-93fe-016ac4dc3386 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:29.132233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-da91afc8-56d1-417b-a3bf-b3bc9c00bb17 req-44f41f60-cd97-4f85-93fe-016ac4dc3386 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:29.143755 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-da91afc8-56d1-417b-a3bf-b3bc9c00bb17 req-44f41f60-cd97-4f85-93fe-016ac4dc3386 service nova] Creating event network-changed:58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 for instance d60599b5-5691-4ad2-ac62-6cc7744f974a on hv-cinder-80152 Oct 14 03:19:29.149290 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-da91afc8-56d1-417b-a3bf-b3bc9c00bb17 req-44f41f60-cd97-4f85-93fe-016ac4dc3386 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Oct 14 03:19:29.150543 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 541/1115] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:19:29.555767 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:29.556379 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:29.562294 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:29.562770 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:29.563198 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:29.564068 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:29.564521 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:29.564936 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:29.760840 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:29.782939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8111bbde-ed1b-4fb5-999e-5b615f24bedc tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.218168 Oct 14 03:19:29.785355 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 575/1116] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:29 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:30.421331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:30.421331 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:30.428189 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:30.428882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:30.429517 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:30.430434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:30.431053 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:30.431640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:30.431796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-baaec4eb-f1b1-45dd-93be-2c922d239e28 req-f93a04e4-fd5f-4e5c-8a77-c56f06c18bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7b2b6d-19a6-45e5-a1ad-731398a95ed0", "name": "network-vif-plugged", "status": "completed", "tag": "9022210d-e752-4633-9cb8-be36d1d5cd36"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:19:30.444088 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-baaec4eb-f1b1-45dd-93be-2c922d239e28 req-f93a04e4-fd5f-4e5c-8a77-c56f06c18bd5 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:30.444569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-baaec4eb-f1b1-45dd-93be-2c922d239e28 req-f93a04e4-fd5f-4e5c-8a77-c56f06c18bd5 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:30.445000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-baaec4eb-f1b1-45dd-93be-2c922d239e28 req-f93a04e4-fd5f-4e5c-8a77-c56f06c18bd5 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:30.457133 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-baaec4eb-f1b1-45dd-93be-2c922d239e28 req-f93a04e4-fd5f-4e5c-8a77-c56f06c18bd5 service nova] Creating event network-vif-plugged:9022210d-e752-4633-9cb8-be36d1d5cd36 for instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 on hv-cinder-80152 Oct 14 03:19:30.462747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-baaec4eb-f1b1-45dd-93be-2c922d239e28 req-f93a04e4-fd5f-4e5c-8a77-c56f06c18bd5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037250 Oct 14 03:19:30.463503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 576/1117] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:19:30.521635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lazy-loading 'services' on Instance uuid d60599b5-5691-4ad2-ac62-6cc7744f974a {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:19:30.752415 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ae4f6bc1-6f2d-4629-ad43-2d4fd7fc3eab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments/bd3e81a3-f0d5-4b49-87b9-ee906ec8d421" status: 202 len: 0 microversion: 2.1 time: 0.336450 Oct 14 03:19:30.753013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 542/1118] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:19:30 2022] DELETE /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments/bd3e81a3-f0d5-4b49-87b9-ee906ec8d421 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:19:30.763023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:30.765286 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:30.772166 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:30.772926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:30.773553 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:30.774379 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:30.774836 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:30.775259 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:30.797646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:30.798585 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:30.805741 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8484473a-a27d-4bf1-bc10-03a05d287f5a tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047442 Oct 14 03:19:30.809453 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:30.810069 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:30.810616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:30.814292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 577/1119] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:19:30 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:19:30.814438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:30.814438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:30.814438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:30.975623 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:30.983754 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-de9ac68f-b13e-41ca-a053-201d310211b1 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.194716 Oct 14 03:19:30.984344 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 543/1120] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:30 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:19:31.168362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-1de49437-73fd-4a60-9ad3-ac7c5d15a277 req-929bd971-8445-4c0d-8938-8dcee6cd731b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60599b5-5691-4ad2-ac62-6cc7744f974a", "tag": "58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:19:31.178605 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1de49437-73fd-4a60-9ad3-ac7c5d15a277 req-929bd971-8445-4c0d-8938-8dcee6cd731b service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:31.179085 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1de49437-73fd-4a60-9ad3-ac7c5d15a277 req-929bd971-8445-4c0d-8938-8dcee6cd731b service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:31.179523 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-1de49437-73fd-4a60-9ad3-ac7c5d15a277 req-929bd971-8445-4c0d-8938-8dcee6cd731b service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:31.191137 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-1de49437-73fd-4a60-9ad3-ac7c5d15a277 req-929bd971-8445-4c0d-8938-8dcee6cd731b service nova] Creating event network-changed:58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 for instance d60599b5-5691-4ad2-ac62-6cc7744f974a on hv-cinder-80152 Oct 14 03:19:31.196670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-1de49437-73fd-4a60-9ad3-ac7c5d15a277 req-929bd971-8445-4c0d-8938-8dcee6cd731b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Oct 14 03:19:31.197265 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 578/1121] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:19:31.818876 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:31.821022 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:31.827342 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:31.827814 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:31.828240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:31.828919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:31.829361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:31.829792 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:31.859044 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0cf80e7e-c522-4859-bbe2-1307479f7be5 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Oct 14 03:19:31.859607 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 544/1122] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:19:31 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:19:32.008423 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:32.009124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:32.015850 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:32.016342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:32.016779 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:32.017472 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:32.018027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:32.020846 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:32.155631 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:32.164270 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-675aa85d-b656-4ab0-b9cc-15981289c76c tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1577 microversion: 2.1 time: 0.160667 Oct 14 03:19:32.164847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 579/1123] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:32 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:32.873090 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:32.875497 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:32.882704 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:32.883188 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:32.883624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:32.884320 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:32.884774 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:32.885198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:32.914495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2e09ded3-d5ff-4a9c-9240-7aa5e6d62ad8 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046993 Oct 14 03:19:32.915048 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 545/1124] 10.222.0.39 () {58 vars in 1302 bytes} [Fri Oct 14 03:19:32 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 03:19:32.925491 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:32.926010 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:32.933089 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:32.933559 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:32.934055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:32.934733 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:32.935178 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:32.935595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:33.008462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] HTTP exception thrown: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a is not attached to volume bd3e81a3-f0d5-4b49-87b9-ee906ec8d421 Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Request method failure captured: Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments/bd3e81a3-f0d5-4b49-87b9-ee906ec8d421 HTTP/1.1 Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNTAzR9E5TrzwryzNBvkluYcZFlGdBQO5oW_uBiGmh3m07pGq7zzioi9IjPHUOXpEAQMtgLllE_7ov0Qx8Zh3PVc63S23yW1-kAwQjBMyLvKLLZ4i2FgVBsB68tQbBK0pJ1JF6UHi6qgXi8bq6w_IBPTDwLLaaNFZ5Ww3SshiBGsP_w Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: f2c0270c3f82423ea62db21e22ac86bd Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-TestMinimumBasicScenario-730547108 Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:19:33.010864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f2c0270c3f82423ea62db21e22ac86bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2c0270c3f82423ea62db21e22ac86bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2c0270c3f82423ea62db21e22ac86bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f2c0270c3f82423ea62db21e22ac86bd"}]}] Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-TestMinimumBasicScenario-730547108 Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: f2c0270c3f82423ea62db21e22ac86bd Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-TestMinimumBasicScenario-730547108 Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-TestMinimumBasicScenario-730547108-project Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: ca9545f301e24e579903df7f87337f8e Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-TestMinimumBasicScenario-730547108-project Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:19:33.012621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a is not attached to volume bd3e81a3-f0d5-4b49-87b9-ee906ec8d421 Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'server_id': 'd60599b5-5691-4ad2-ac62-6cc7744f974a', 'id': 'bd3e81a3-f0d5-4b49-87b9-ee906ec8d421'} Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd3e81a3-f0d5-4b49-87b9-ee906ec8d421. Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:19:33.014106 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a is not attached to volume bd3e81a3-f0d5-4b49-87b9-ee906ec8d421 Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a is not attached to volume bd3e81a3-f0d5-4b49-87b9-ee906ec8d421 Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:33.015657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Returning 404 to user: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a is not attached to volume bd3e81a3-f0d5-4b49-87b9-ee906ec8d421 {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:19:33.016933 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-67046fef-f567-42f3-a4be-79755caaf5f2 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments/bd3e81a3-f0d5-4b49-87b9-ee906ec8d421" status: 404 len: 154 microversion: 2.1 time: 0.090775 Oct 14 03:19:33.016933 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 580/1125] 10.222.0.39 () {58 vars in 1416 bytes} [Fri Oct 14 03:19:32 2022] DELETE /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a/os-volume_attachments/bd3e81a3-f0d5-4b49-87b9-ee906ec8d421 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:19:33.187767 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:33.188369 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:33.195001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:33.195475 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:33.195951 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:33.196627 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:33.197073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:33.197489 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:33.327796 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:33.330172 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:19:33.336842 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8506613f-732a-4afb-8efd-568988116cc3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1564 microversion: 2.1 time: 0.153370 Oct 14 03:19:33.337410 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 546/1126] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:33 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:34.300080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:34.300580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:34.308298 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:34.308773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:34.309208 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:34.309922 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:34.310372 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:34.310792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:34.334567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:19:34.448058 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:19:34.665230 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-12efeefd-683b-46d4-8e56-c9abcd58020b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 204 len: 0 microversion: 2.1 time: 0.368640 Oct 14 03:19:34.665869 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 581/1127] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:19:34 2022] DELETE /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:19:34.674146 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:34.674814 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:34.682923 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:34.683398 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:34.683828 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:34.684511 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:34.684961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:34.685382 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:34.814547 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:34.822404 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7ffdc70c-368d-43f0-867e-5f948ffa6969 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1554 microversion: 2.1 time: 0.152090 Oct 14 03:19:34.822972 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 547/1128] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:34 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:35.846525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:35.847224 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:35.853565 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:35.854088 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:35.854511 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:35.855197 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:35.855648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:35.856069 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:35.981126 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:35.988702 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-d73ce75b-b28e-413d-849a-9396d980d04f tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1554 microversion: 2.1 time: 0.146438 Oct 14 03:19:35.990117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 582/1129] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:35 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:19:37.012798 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:37.013375 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:37.019994 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:37.020498 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:37.020961 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:37.021646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:37.022129 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:37.022544 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:37.084701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:37.092409 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-09a8f2c2-688e-47a6-93e0-c0b6e5c1e56b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1512 microversion: 2.1 time: 0.083714 Oct 14 03:19:37.098866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 548/1130] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:37 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1512 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:37.162093 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-50b5d129-7a2d-4094-8d05-e8ac564c5711 req-e1396785-9ebb-43d3-b2f7-748ef788963d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60599b5-5691-4ad2-ac62-6cc7744f974a", "name": "network-vif-deleted", "tag": "58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:19:37.171894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-50b5d129-7a2d-4094-8d05-e8ac564c5711 req-e1396785-9ebb-43d3-b2f7-748ef788963d service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:37.172367 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-50b5d129-7a2d-4094-8d05-e8ac564c5711 req-e1396785-9ebb-43d3-b2f7-748ef788963d service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:37.172796 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-50b5d129-7a2d-4094-8d05-e8ac564c5711 req-e1396785-9ebb-43d3-b2f7-748ef788963d service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:37.183342 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-50b5d129-7a2d-4094-8d05-e8ac564c5711 req-e1396785-9ebb-43d3-b2f7-748ef788963d service nova] Creating event network-vif-deleted:58dad5a6-7dc5-45c5-9ec4-b5188e89a6d7 for instance d60599b5-5691-4ad2-ac62-6cc7744f974a on hv-cinder-80152 Oct 14 03:19:37.188037 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-50b5d129-7a2d-4094-8d05-e8ac564c5711 req-e1396785-9ebb-43d3-b2f7-748ef788963d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030339 Oct 14 03:19:37.188782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 583/1131] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:19:38.116073 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:38.116676 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:38.123253 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:38.123781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:38.124163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:38.124849 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:38.125297 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:38.125717 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:38.156960 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:38.157432 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:38.157888 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:38.158367 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lazy-loading 'fault' on Instance uuid d60599b5-5691-4ad2-ac62-6cc7744f974a {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:19:38.202876 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9545f301e24e579903df7f87337f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2c0270c3f82423ea62db21e22ac86bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:19:38.210526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6fb16577-bb99-4fac-8a84-deebc8f131ab tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 200 len: 1348 microversion: 2.1 time: 0.099196 Oct 14 03:19:38.211091 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 549/1132] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:38 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:19:39.235308 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:39.236008 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] [instance: d60599b5-5691-4ad2-ac62-6cc7744f974a] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:19:39.237948 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:19:39.243118 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:39.243598 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:39.244031 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:39.244720 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:19:39.245172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:19:39.245595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:19:39.259115 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] HTTP exception thrown: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a could not be found. Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Request method failure captured: Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a HTTP/1.1 Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNTAzR9E5TrzwryzNBvkluYcZFlGdBQO5oW_uBiGmh3m07pGq7zzioi9IjPHUOXpEAQMtgLllE_7ov0Qx8Zh3PVc63S23yW1-kAwQjBMyLvKLLZ4i2FgVBsB68tQbBK0pJ1JF6UHi6qgXi8bq6w_IBPTDwLLaaNFZ5Ww3SshiBGsP_w Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: f2c0270c3f82423ea62db21e22ac86bd Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-TestMinimumBasicScenario-730547108 Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:19:39.266167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f2c0270c3f82423ea62db21e22ac86bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2c0270c3f82423ea62db21e22ac86bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f2c0270c3f82423ea62db21e22ac86bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f2c0270c3f82423ea62db21e22ac86bd"}]}] Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-TestMinimumBasicScenario-730547108 Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: f2c0270c3f82423ea62db21e22ac86bd Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-TestMinimumBasicScenario-730547108 Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-TestMinimumBasicScenario-730547108-project Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: ca9545f301e24e579903df7f87337f8e Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-TestMinimumBasicScenario-730547108-project Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a could not be found. Oct 14 03:19:39.267812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'd60599b5-5691-4ad2-ac62-6cc7744f974a'} Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a could not be found. Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:19:39.268799 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a could not be found. Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a could not be found. Oct 14 03:19:39.270580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:19:39.272541 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Returning 404 to user: Instance d60599b5-5691-4ad2-ac62-6cc7744f974a could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:19:39.272541 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-92bbabce-733a-4f65-b74d-98c523f1f220 tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a" status: 404 len: 111 microversion: 2.1 time: 0.031549 Oct 14 03:19:39.272541 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 584/1133] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:19:39 2022] GET /compute/v2.1/servers/d60599b5-5691-4ad2-ac62-6cc7744f974a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:19:39.272808 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fd45a069-a2bb-48c4-a98b-6444941de12b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] Calling method '.version_select at 0x7f2beba7d8b0>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:19:39.357572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fd45a069-a2bb-48c4-a98b-6444941de12b tempest-TestMinimumBasicScenario-730547108 tempest-TestMinimumBasicScenario-730547108-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1706297826" status: 202 len: 0 microversion: 2.1 time: 0.090688 Oct 14 03:19:39.358164 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 550/1134] 10.222.0.39 () {58 vars in 1272 bytes} [Fri Oct 14 03:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1706297826 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:20:53.036372 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:20:53.040547 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-f1c48a55-63f8-47d6-9eb4-46fec5a5c6a1 req-c3eff1f9-68a6-4947-b98d-155250053bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7b2b6d-19a6-45e5-a1ad-731398a95ed0", "tag": "9022210d-e752-4633-9cb8-be36d1d5cd36"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:20:53.051740 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-f1c48a55-63f8-47d6-9eb4-46fec5a5c6a1 req-c3eff1f9-68a6-4947-b98d-155250053bb3 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:53.052211 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-f1c48a55-63f8-47d6-9eb4-46fec5a5c6a1 req-c3eff1f9-68a6-4947-b98d-155250053bb3 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:53.052658 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-f1c48a55-63f8-47d6-9eb4-46fec5a5c6a1 req-c3eff1f9-68a6-4947-b98d-155250053bb3 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:53.064275 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-f1c48a55-63f8-47d6-9eb4-46fec5a5c6a1 req-c3eff1f9-68a6-4947-b98d-155250053bb3 service nova] Creating event network-changed:9022210d-e752-4633-9cb8-be36d1d5cd36 for instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 on hv-cinder-80152 Oct 14 03:20:53.069262 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-f1c48a55-63f8-47d6-9eb4-46fec5a5c6a1 req-c3eff1f9-68a6-4947-b98d-155250053bb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034980 Oct 14 03:20:53.069858 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 585/1135] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:20:53.102345 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=21 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:20:53.103658 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:20:53.108368 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:20:53.108861 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:20:53.115068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:53.115558 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:53.115997 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:53.116700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:53.117266 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:53.117703 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:53.148899 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:20:53.425956 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f6e133cf-6903-4a05-a22b-637e97245f4e tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 204 len: 0 microversion: 2.1 time: 0.325188 Oct 14 03:20:53.426559 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 551/1136] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:20:53 2022] DELETE /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:20:53.435994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:20:53.436697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:20:53.443833 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:53.444317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:53.444990 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:53.445738 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:53.446213 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:53.446635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:53.594710 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:20:53.602465 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e81b2310-99dd-4d1a-a2ab-cf743022fe97 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.171423 Oct 14 03:20:53.603052 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 586/1137] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:20:53 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:20:54.628130 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:20:54.628863 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:20:54.636193 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:54.636724 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:54.637157 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:54.637879 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:54.638335 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:54.642198 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:54.770530 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:20:54.778919 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ee55ab5a-799a-4d62-8814-e0e11d55e2e7 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1570 microversion: 2.1 time: 0.155431 Oct 14 03:20:54.793465 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 552/1138] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:20:54 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:20:55.802472 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:20:55.803081 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:20:55.809569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:55.810081 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:55.810546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:55.811236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:55.811688 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:55.812107 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:55.939985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:20:55.947812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0cf24949-4f6e-415d-bcb9-c65e3517e4c3 tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1451 microversion: 2.1 time: 0.149170 Oct 14 03:20:55.948742 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 587/1139] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:20:55 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:20:56.028242 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-90f79e56-4e75-46fd-9868-61f47ce8f625 req-85dc09d8-8318-49b9-9939-aa7619f567a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7b2b6d-19a6-45e5-a1ad-731398a95ed0", "name": "network-vif-deleted", "tag": "9022210d-e752-4633-9cb8-be36d1d5cd36"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:20:56.037883 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-90f79e56-4e75-46fd-9868-61f47ce8f625 req-85dc09d8-8318-49b9-9939-aa7619f567a8 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:56.046455 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-90f79e56-4e75-46fd-9868-61f47ce8f625 req-85dc09d8-8318-49b9-9939-aa7619f567a8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:56.046455 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-90f79e56-4e75-46fd-9868-61f47ce8f625 req-85dc09d8-8318-49b9-9939-aa7619f567a8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:56.049561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-90f79e56-4e75-46fd-9868-61f47ce8f625 req-85dc09d8-8318-49b9-9939-aa7619f567a8 service nova] Creating event network-vif-deleted:9022210d-e752-4633-9cb8-be36d1d5cd36 for instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 on hv-cinder-80152 Oct 14 03:20:56.054678 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-90f79e56-4e75-46fd-9868-61f47ce8f625 req-85dc09d8-8318-49b9-9939-aa7619f567a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030576 Oct 14 03:20:56.055264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 553/1140] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:20:56.970817 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:20:56.971412 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:20:56.977699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:56.978718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:56.979182 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:56.979873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:56.980329 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:56.980749 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:57.012143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:57.012624 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:57.013061 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:57.013505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lazy-loading 'fault' on Instance uuid fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:20:57.058019 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42efd916cb4b4980a45199d8cc9a4389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a302ca039794ab599996fcda417a1c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:20:57.066010 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-2575233c-47ee-4ae3-9c06-8461fd404a7f tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 200 len: 1225 microversion: 2.1 time: 0.099058 Oct 14 03:20:57.066650 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 588/1141] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:20:56 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:20:58.089495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:20:58.090219 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [instance: fa7b2b6d-19a6-45e5-a1ad-731398a95ed0] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:20:58.096390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:58.096867 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:58.097298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:58.098013 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:20:58.098468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:20:58.098887 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:20:58.111954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] HTTP exception thrown: Instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 could not be found. Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Request method failure captured: Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 HTTP/1.1 Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNRXqUgizBuMcwiZ9NN5izvIbYvCfrWXaNrJFtF3R0oftYwTS-XOtEn1F5gETlsUeXnOv7ppdi07szqdaLdEKIcH66rzXs7WNs1o3hrEoAMkkqQQ93odnW4Ud6CstYuD9FnUN7qRAz8KMAP9KOQLSGFxZBqB4y4xUU1EADUkPyVfbvY Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 0a302ca039794ab599996fcda417a1c6 Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-TestShelveInstance-904147656 Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:20:58.113561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a302ca039794ab599996fcda417a1c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a302ca039794ab599996fcda417a1c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a302ca039794ab599996fcda417a1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a302ca039794ab599996fcda417a1c6"}]}] Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-TestShelveInstance-904147656 Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 0a302ca039794ab599996fcda417a1c6 Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-TestShelveInstance-904147656 Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-TestShelveInstance-904147656-project Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: 42efd916cb4b4980a45199d8cc9a4389 Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-TestShelveInstance-904147656-project Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 could not be found. Oct 14 03:20:58.115371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'fa7b2b6d-19a6-45e5-a1ad-731398a95ed0'} Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 could not be found. Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:20:58.116262 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 could not be found. Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 could not be found. Oct 14 03:20:58.117913 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:20:58.119479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Returning 404 to user: Instance fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:20:58.119479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ddc9fd4d-cea1-4bc8-a6aa-25caf136a33b tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0" status: 404 len: 111 microversion: 2.1 time: 0.030271 Oct 14 03:20:58.119479 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 554/1142] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:20:58 2022] GET /compute/v2.1/servers/fa7b2b6d-19a6-45e5-a1ad-731398a95ed0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:20:58.373191 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-daf31072-c6fd-4cab-bc0c-46de526aab6a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] Calling method '.version_select at 0x7f2bebb0d8b0>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:20:58.377592 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR oslo.messaging._drivers.impl_rabbit [None req-daf31072-c6fd-4cab-bc0c-46de526aab6a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [23046567-1069-412f-82c6-a8b16ef4fa4c] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 14 03:20:59.385390 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO oslo.messaging._drivers.impl_rabbit [None req-daf31072-c6fd-4cab-bc0c-46de526aab6a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] [23046567-1069-412f-82c6-a8b16ef4fa4c] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60358. Oct 14 03:20:59.466174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-daf31072-c6fd-4cab-bc0c-46de526aab6a tempest-TestShelveInstance-904147656 tempest-TestShelveInstance-904147656-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1759476879" status: 202 len: 0 microversion: 2.1 time: 1.097370 Oct 14 03:20:59.466773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 589/1143] 10.222.0.39 () {58 vars in 1254 bytes} [Fri Oct 14 03:20:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1759476879 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 03:21:20.361090 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:20.362190 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:20.537656 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-95e1d7b9-f64d-478e-b8ba-a073c89ac9c8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Action: 'create', calling method: .version_select at 0x7f2beba70c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1438726321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeu2wo/ff4fvIL4NZ8+mgJJdgwicGEuNIfsrzvXn0B4CGZUvsV0PmXatjG+6f+GXTSQpfwW/+Jaxxoze7jUeizv+A2UPNjZ82B3bFMMaDGyG8fQ+UH3hFv5E6+uBGQDPQ=="}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:21:20.554103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-95e1d7b9-f64d-478e-b8ba-a073c89ac9c8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Getting quotas for project 094ec37b955e4518b7abffd09afef4f0. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:21:20.558692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-95e1d7b9-f64d-478e-b8ba-a073c89ac9c8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Getting quotas for user fcc0e4c5bee64180884513f13757140c and project 094ec37b955e4518b7abffd09afef4f0. Resources: {'key_pairs'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:21:20.654149 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-95e1d7b9-f64d-478e-b8ba-a073c89ac9c8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.297775 Oct 14 03:21:20.654910 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 555/1144] 10.222.0.39 () {60 vars in 1159 bytes} [Fri Oct 14 03:21:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 03:21:40.695939 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=22 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:40.696792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:40.701285 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-373635676", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1438726321", "security_groups": [{"name": "tempest-secgroup-smoke-1014083988"}], "block_device_mapping_v2": [{"uuid": "da3187d2-c7a1-4a5e-be86-05c75520a508", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "977c90dd-1f4c-40e4-bab8-7e46041a9b05"}]}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:21:40.819312 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] validate_networks() for [('977c90dd-1f4c-40e4-bab8-7e46041a9b05', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:21:41.280248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:21:41.280670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:21:41.281142 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:21:41.281549 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:21:41.281995 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:21:41.290613 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:41.291088 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:41.291520 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:41.292240 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:41.292693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:41.293114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:41.310890 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Getting quotas for project 094ec37b955e4518b7abffd09afef4f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:21:41.314877 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Getting quotas for user fcc0e4c5bee64180884513f13757140c and project 094ec37b955e4518b7abffd09afef4f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:21:41.370098 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:21:41.372693 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da3187d2-c7a1-4a5e-be86-05c75520a508',volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:21:41.791083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6d9ece56-fd62-4648-9860-ef2e8a8ae95e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.096462 Oct 14 03:21:41.791824 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 590/1145] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:21:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:21:41.803865 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c0cd2e49-2679-4e24-822b-5c01a6d54203 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:41.806197 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c0cd2e49-2679-4e24-822b-5c01a6d54203 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:41.807878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=4 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:41.808736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:41.862576 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c0cd2e49-2679-4e24-822b-5c01a6d54203 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:41.875279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c0cd2e49-2679-4e24-822b-5c01a6d54203 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1094 microversion: 2.1 time: 0.075145 Oct 14 03:21:41.876155 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 556/1146] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:41 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:42.911741 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:42.912385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:42.918992 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:42.919431 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:42.919865 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:42.920548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:42.921000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:42.921426 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:42.984364 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:42.992272 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-59abb48c-c944-4935-b8d6-748cbd5c119d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1144 microversion: 2.1 time: 0.084985 Oct 14 03:21:42.994321 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 591/1147] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:42 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:44.016108 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:44.016723 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:44.023910 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:44.024401 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:44.024839 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:44.025531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:44.026016 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:44.026446 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:44.088131 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:44.096711 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d3437324-87e5-4363-bb44-bd5d25c18d8c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1200 microversion: 2.1 time: 0.084947 Oct 14 03:21:44.098616 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 557/1148] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:44 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:45.120543 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:45.124926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:45.127719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:45.128204 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:45.128633 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:45.129318 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:45.129779 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:45.130236 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:45.263760 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:45.268322 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-42cd5860-6425-4930-9a16-9e9d3539313a tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1278 microversion: 2.1 time: 0.152306 Oct 14 03:21:45.268904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 592/1149] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:45 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:45.670228 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-4673c126-0903-468c-b9f7-60800130fb2c req-72334491-e746-4b67-bb3b-d1c11512b969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2499230a-4299-42fb-b9a7-5f67e01e290f", "tag": "9a364b5f-406b-48fd-994b-03b4466b77cc"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:21:45.679803 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-4673c126-0903-468c-b9f7-60800130fb2c req-72334491-e746-4b67-bb3b-d1c11512b969 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:45.680223 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-4673c126-0903-468c-b9f7-60800130fb2c req-72334491-e746-4b67-bb3b-d1c11512b969 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:45.680646 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-4673c126-0903-468c-b9f7-60800130fb2c req-72334491-e746-4b67-bb3b-d1c11512b969 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:45.693459 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-4673c126-0903-468c-b9f7-60800130fb2c req-72334491-e746-4b67-bb3b-d1c11512b969 service nova] Creating event network-changed:9a364b5f-406b-48fd-994b-03b4466b77cc for instance 2499230a-4299-42fb-b9a7-5f67e01e290f on hv-cinder-80152 Oct 14 03:21:45.698550 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-4673c126-0903-468c-b9f7-60800130fb2c req-72334491-e746-4b67-bb3b-d1c11512b969 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031974 Oct 14 03:21:45.699137 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 558/1150] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:21:46.291556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:46.292172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:46.299063 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:46.299536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:46.299965 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:46.300648 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:46.301094 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:46.301505 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:46.436395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:46.443985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f67d9ac5-6dcd-4786-80e2-d5222f0a410e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.156295 Oct 14 03:21:46.444548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 593/1151] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:46 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:47.466843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:47.467602 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:47.473736 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:47.474240 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:47.474667 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:47.475340 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:47.475784 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:47.476200 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:47.604694 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:47.612760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9a2ce809-4f42-4450-8dde-6ff9b1258b59 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.150604 Oct 14 03:21:47.613300 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 559/1152] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:47 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:48.635819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:48.636402 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:48.643258 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:48.643734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:48.644168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:48.644873 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:48.645319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:48.645735 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:48.775530 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:48.783024 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-8d986ce0-8e24-4ff7-b660-b7cda28cf0f7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.151054 Oct 14 03:21:48.783575 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 594/1153] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:48 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:49.805357 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:49.811492 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:49.812469 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:49.812949 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:49.813382 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:49.814107 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:49.814551 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:49.814967 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:49.946054 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:49.954267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-6de758df-42e0-4c32-bfbc-18b050deb6e7 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.152784 Oct 14 03:21:49.954820 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 560/1154] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:49 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:50.977844 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:50.978495 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:50.985391 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:50.985907 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:50.986350 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:50.987040 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:50.987531 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:50.987957 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:51.114636 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:51.122521 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-26e1908d-0b6d-4262-a7c5-795ded6d6d19 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.148670 Oct 14 03:21:51.123083 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 595/1155] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:50 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:52.144417 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:52.145052 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:52.147499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:52.152202 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:52.152672 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:52.153103 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:52.153795 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:52.154267 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:52.157714 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:52.285619 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:52.293316 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4185a184-1ac5-4020-9015-57794f76fefc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.152829 Oct 14 03:21:52.294427 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 561/1156] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:52 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:53.316373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:53.316952 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:53.318793 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:53.319444 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=6 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:53.324680 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:53.325708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:53.326157 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:53.326843 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:53.327286 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:53.327699 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:53.454583 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:53.462253 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a1cd8fc5-2af0-4b01-8c91-2dbf3a41ce5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.149745 Oct 14 03:21:53.463025 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 596/1157] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:53 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:54.484702 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:54.500741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:54.500741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:54.500741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:54.500741 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:54.501182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:54.501182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:54.501182 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:54.628524 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:54.636205 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-bb3e77df-bd72-4fcd-920f-b807fe8cbaff tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.155846 Oct 14 03:21:54.636766 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 562/1158] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:54 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:55.659585 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:55.660158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:55.666440 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:55.666919 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:55.667354 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:55.668047 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:55.669126 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:55.669557 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:55.798622 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:55.806206 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-64017ef3-74a8-411b-b3b8-5f43ca217702 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.150489 Oct 14 03:21:55.806747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 597/1159] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:55 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:56.828473 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:56.829093 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:56.835643 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:56.836125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:56.836561 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:56.837251 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:56.837705 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:56.838156 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:56.969199 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:56.977143 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0ecd9f9e-4d0d-472b-b5de-e1dd85da586d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.152504 Oct 14 03:21:56.986692 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 563/1160] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:56 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:57.248969 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-0451cb0d-f43f-48f4-979e-9840daab4cb7 req-dc8c8d2c-1ee7-41c4-8a84-24bd27dbf2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2499230a-4299-42fb-b9a7-5f67e01e290f", "name": "network-vif-plugged", "status": "completed", "tag": "9a364b5f-406b-48fd-994b-03b4466b77cc"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:21:57.259075 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-0451cb0d-f43f-48f4-979e-9840daab4cb7 req-dc8c8d2c-1ee7-41c4-8a84-24bd27dbf2a8 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:57.259552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-0451cb0d-f43f-48f4-979e-9840daab4cb7 req-dc8c8d2c-1ee7-41c4-8a84-24bd27dbf2a8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:57.259984 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-0451cb0d-f43f-48f4-979e-9840daab4cb7 req-dc8c8d2c-1ee7-41c4-8a84-24bd27dbf2a8 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:57.270625 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-0451cb0d-f43f-48f4-979e-9840daab4cb7 req-dc8c8d2c-1ee7-41c4-8a84-24bd27dbf2a8 service nova] Creating event network-vif-plugged:9a364b5f-406b-48fd-994b-03b4466b77cc for instance 2499230a-4299-42fb-b9a7-5f67e01e290f on hv-cinder-80152 Oct 14 03:21:57.275670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-0451cb0d-f43f-48f4-979e-9840daab4cb7 req-dc8c8d2c-1ee7-41c4-8a84-24bd27dbf2a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030498 Oct 14 03:21:57.276240 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 598/1161] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:21:58.000955 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:58.001577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:58.008160 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:58.008645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:58.009086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:58.009804 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:58.010261 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:58.010687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:58.139866 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:58.147495 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2fb69b30-ba79-4368-857b-e6135c724e5e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1266 microversion: 2.1 time: 0.151002 Oct 14 03:21:58.148055 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 564/1162] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:57 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:59.171243 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:59.171944 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:59.178116 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:59.178596 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:59.179035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:59.179718 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:59.180168 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:59.180591 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:59.311385 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:59.319027 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0271f9d2-0b48-448b-b6a9-a639275ee25c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1452 microversion: 2.1 time: 0.152517 Oct 14 03:21:59.319595 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 599/1163] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:59 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:21:59.341305 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:21:59.341954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:21:59.348371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:59.348853 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:59.349284 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:59.350002 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:21:59.350457 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:21:59.350882 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:21:59.483390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:21:59.491565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1118ecd3-02f3-408a-ad30-ddb38d769e7b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1452 microversion: 2.1 time: 0.154191 Oct 14 03:21:59.492154 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 565/1164] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:21:59 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:22:01.367000 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-8b99fbe2-2cff-4d1d-9c6a-7b8658e11004 req-ee73e8d9-1443-4c09-a694-94214dd337d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2499230a-4299-42fb-b9a7-5f67e01e290f", "tag": "9a364b5f-406b-48fd-994b-03b4466b77cc"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:22:01.377196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8b99fbe2-2cff-4d1d-9c6a-7b8658e11004 req-ee73e8d9-1443-4c09-a694-94214dd337d6 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:22:01.377676 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8b99fbe2-2cff-4d1d-9c6a-7b8658e11004 req-ee73e8d9-1443-4c09-a694-94214dd337d6 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:22:01.378132 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-8b99fbe2-2cff-4d1d-9c6a-7b8658e11004 req-ee73e8d9-1443-4c09-a694-94214dd337d6 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:22:01.391123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-8b99fbe2-2cff-4d1d-9c6a-7b8658e11004 req-ee73e8d9-1443-4c09-a694-94214dd337d6 service nova] Creating event network-changed:9a364b5f-406b-48fd-994b-03b4466b77cc for instance 2499230a-4299-42fb-b9a7-5f67e01e290f on hv-cinder-80152 Oct 14 03:22:01.396167 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-8b99fbe2-2cff-4d1d-9c6a-7b8658e11004 req-ee73e8d9-1443-4c09-a694-94214dd337d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033173 Oct 14 03:22:01.397100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 600/1165] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:23:58.510846 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=22 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:23:58.511608 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=50 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:23:58.513083 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 14 03:23:58.513238 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Fri Oct 14 03:23:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f (ip 10.222.0.39) !!! Oct 14 03:23:58.518361 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:23:58.518852 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:23:58.525729 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:23:58.528740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:23:58.528740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:23:58.528740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:23:58.528740 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:23:58.529160 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:23:58.553707 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:23:58.827083 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-487ce8f7-6cb4-4ee7-9f0b-29f2b77df627 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 204 len: 0 microversion: 2.1 time: 0.318048 Oct 14 03:23:58.827675 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 566/1166] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:23:58 2022] DELETE /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:23:58.834235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:23:58.836227 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=54 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:23:58.836552 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 14 03:23:58.836695 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Fri Oct 14 03:23:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f (ip 10.222.0.39) !!! Oct 14 03:23:58.842801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:23:58.843498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:23:58.850655 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:23:58.851121 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:23:58.851546 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:23:58.852220 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:23:58.852664 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:23:58.853177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:23:59.039247 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:23:59.047713 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-4cfc178d-a4fa-4959-a869-ced38cc54559 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1577 microversion: 2.1 time: 0.215618 Oct 14 03:23:59.048279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 601/1167] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:23:58 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:00.071933 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:00.072635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:00.079089 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:00.079572 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:00.080594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:00.081351 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:00.081833 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:00.082260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:00.258124 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:00.265857 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-63e0a7b7-ff8d-4cf2-9d63-68c3e6a828f2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1577 microversion: 2.1 time: 0.198170 Oct 14 03:24:00.266421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 567/1168] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:00 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:01.289475 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:01.290066 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:01.296570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:01.297055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:01.297494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:01.298216 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:01.298677 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:01.299101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:01.432414 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:01.440619 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3b4f0a56-deab-42ad-a23d-247f1bf25720 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1577 microversion: 2.1 time: 0.155448 Oct 14 03:24:01.441228 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 602/1169] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:01 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:01.896594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-c403ce40-f78d-418f-a192-2dacd5e0d823 req-53011ae0-d5bb-4840-8b9e-5e0466e92fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2499230a-4299-42fb-b9a7-5f67e01e290f", "name": "network-vif-deleted", "tag": "9a364b5f-406b-48fd-994b-03b4466b77cc"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:24:01.907032 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-c403ce40-f78d-418f-a192-2dacd5e0d823 req-53011ae0-d5bb-4840-8b9e-5e0466e92fa6 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:01.907502 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-c403ce40-f78d-418f-a192-2dacd5e0d823 req-53011ae0-d5bb-4840-8b9e-5e0466e92fa6 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:01.907934 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-c403ce40-f78d-418f-a192-2dacd5e0d823 req-53011ae0-d5bb-4840-8b9e-5e0466e92fa6 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:01.921496 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-c403ce40-f78d-418f-a192-2dacd5e0d823 req-53011ae0-d5bb-4840-8b9e-5e0466e92fa6 service nova] Creating event network-vif-deleted:9a364b5f-406b-48fd-994b-03b4466b77cc for instance 2499230a-4299-42fb-b9a7-5f67e01e290f on hv-cinder-80152 Oct 14 03:24:01.927040 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-c403ce40-f78d-418f-a192-2dacd5e0d823 req-53011ae0-d5bb-4840-8b9e-5e0466e92fa6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093991 Oct 14 03:24:01.927639 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 568/1170] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:24:02.464123 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:02.465395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:02.472261 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:02.472750 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:02.473190 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:02.473937 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:02.474396 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:02.474822 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:02.541175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:02.548773 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-9f6e0dbf-ca53-4add-9e6e-8ada056870b3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 200 len: 1225 microversion: 2.1 time: 0.088685 Oct 14 03:24:02.549838 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 603/1171] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:02 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:24:03.572779 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:03.573481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:03.579628 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:03.580105 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:03.580540 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:03.581219 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:03.581668 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:03.582125 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:03.594988 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] HTTP exception thrown: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Request method failure captured: Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f HTTP/1.1 Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNWqrdXtfACSrxCC5vtCM-C8j-L3b-Fyfw1SNEkokI-z8zwg4ZvDrIa1-bz-e8M9We0RC2U0T5E42gDpRNpnKfrq0WMq9A14Uyqu_0n1mVtvxvNl5lCDnxt8jtZohnrm2gOTWH8wfoWivdyv_F_NG_R24GRTtnnQG60ds4XF6lUXMdM Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:24:03.597068 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_094ec37b955e4518b7abffd09afef4f0"}]}] Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: fcc0e4c5bee64180884513f13757140c Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:24:03.602587 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '2499230a-4299-42fb-b9a7-5f67e01e290f'} Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:24:03.603691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:24:03.605390 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:24:03.606928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Returning 404 to user: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:24:03.606928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f3103fe7-4709-4b79-bbce-dbe338b3533d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 404 len: 111 microversion: 2.1 time: 0.030438 Oct 14 03:24:03.606928 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 569/1172] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:03 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:24:03.671905 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-81733535", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1438726321", "security_groups": [{"name": "tempest-secgroup-smoke-1014083988"}], "block_device_mapping_v2": [{"uuid": "da3187d2-c7a1-4a5e-be86-05c75520a508", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "977c90dd-1f4c-40e4-bab8-7e46041a9b05"}]}} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:24:03.782670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.network.neutron [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] validate_networks() for [('977c90dd-1f4c-40e4-bab8-7e46041a9b05', None, None, None, None, None)] {{(pid=119284) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:24:04.373872 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Flavor limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:24:04.374292 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Image limits 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:24:04.374761 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Flavor pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:24:04.375161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Image pref 0:0:0 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:24:04.375563 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.virt.hardware [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119284) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:24:04.384506 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:04.384981 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:04.385408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:04.386157 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:04.386606 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:04.387023 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:04.403580 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Getting quotas for project 094ec37b955e4518b7abffd09afef4f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:24:04.407467 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.quota [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Getting quotas for user fcc0e4c5bee64180884513f13757140c and project 094ec37b955e4518b7abffd09afef4f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119284) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:24:04.462911 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Going to run 1 instances... {{(pid=119284) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:24:04.465080 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da3187d2-c7a1-4a5e-be86-05c75520a508',volume_size=None,volume_type=None)] {{(pid=119284) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:24:04.864268 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-bd1f1dc1-b70a-4735-ad9e-2be6b20ab433 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.195899 Oct 14 03:24:04.864909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 604/1173] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:24:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:24:04.876237 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-80e243b1-ae4c-42b4-8685-27771da633c4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:04.877387 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-80e243b1-ae4c-42b4-8685-27771da633c4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:04.934339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-80e243b1-ae4c-42b4-8685-27771da633c4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:04.942047 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-80e243b1-ae4c-42b4-8685-27771da633c4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1093 microversion: 2.1 time: 0.069837 Oct 14 03:24:04.942594 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 570/1174] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:04 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:05.964504 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7af9c0b1-08b5-4825-82f9-18bae28dc54e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:05.965124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7af9c0b1-08b5-4825-82f9-18bae28dc54e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:06.018085 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7af9c0b1-08b5-4825-82f9-18bae28dc54e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:06.024968 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7af9c0b1-08b5-4825-82f9-18bae28dc54e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1093 microversion: 2.1 time: 0.064832 Oct 14 03:24:06.025533 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 605/1175] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:05 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:07.047101 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0c4d3ff0-6241-447d-9688-abcb3fe20e6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:07.047709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0c4d3ff0-6241-447d-9688-abcb3fe20e6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:07.100161 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0c4d3ff0-6241-447d-9688-abcb3fe20e6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:07.107001 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0c4d3ff0-6241-447d-9688-abcb3fe20e6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1093 microversion: 2.1 time: 0.063641 Oct 14 03:24:07.111012 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 571/1176] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:07 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:08.129304 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0f27b582-704c-4b28-aed9-6653cd331939 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:08.129984 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0f27b582-704c-4b28-aed9-6653cd331939 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:08.182274 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0f27b582-704c-4b28-aed9-6653cd331939 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:08.189036 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0f27b582-704c-4b28-aed9-6653cd331939 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1093 microversion: 2.1 time: 0.063611 Oct 14 03:24:08.189590 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 606/1177] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:08 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:09.211562 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:09.212179 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:09.218648 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:09.219124 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:09.219565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:09.220249 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:09.220700 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:09.221120 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:09.283967 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:09.291670 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c2a2f198-1716-486f-ada6-7238fec83040 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1143 microversion: 2.1 time: 0.084006 Oct 14 03:24:09.292231 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 572/1178] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:09 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:10.315152 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:10.315789 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:10.322255 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:10.322734 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:10.323170 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:10.323861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:10.324312 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:10.324732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:10.385854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:10.395117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-1bc57faf-072b-4bae-a004-0d09fcf6517b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1191 microversion: 2.1 time: 0.084384 Oct 14 03:24:10.395721 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 607/1179] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:10 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:11.420499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:11.421106 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:11.427602 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:11.428076 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:11.428503 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:11.429186 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:11.429640 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:11.430171 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:11.492826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:11.500645 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-ac2558c2-50de-4dc8-9ce2-b879879198ba tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1209 microversion: 2.1 time: 0.084019 Oct 14 03:24:11.501526 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 573/1180] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:11 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:12.523769 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:12.524462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:12.530929 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:12.531515 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:12.532244 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:12.533519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:12.534066 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:12.534556 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:12.667001 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:12.675581 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a5a07324-8843-4554-9898-dfaf494ef8e2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1277 microversion: 2.1 time: 0.155881 Oct 14 03:24:12.676153 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 608/1181] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:12 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:12.980104 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-d002a6b5-bac6-44d4-bd45-b905c416be75 req-4819f47d-2c86-4d1f-aff5-00b387510371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546", "tag": "fb866d3c-4aaa-4710-8d9d-2b3351143b4a"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:24:12.991943 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-d002a6b5-bac6-44d4-bd45-b905c416be75 req-4819f47d-2c86-4d1f-aff5-00b387510371 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:12.992419 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-d002a6b5-bac6-44d4-bd45-b905c416be75 req-4819f47d-2c86-4d1f-aff5-00b387510371 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:12.992849 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-d002a6b5-bac6-44d4-bd45-b905c416be75 req-4819f47d-2c86-4d1f-aff5-00b387510371 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:13.004691 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-d002a6b5-bac6-44d4-bd45-b905c416be75 req-4819f47d-2c86-4d1f-aff5-00b387510371 service nova] Creating event network-changed:fb866d3c-4aaa-4710-8d9d-2b3351143b4a for instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 on hv-cinder-80152 Oct 14 03:24:13.010141 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-d002a6b5-bac6-44d4-bd45-b905c416be75 req-4819f47d-2c86-4d1f-aff5-00b387510371 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033655 Oct 14 03:24:13.011075 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 574/1182] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:24:13.697996 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:13.698578 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:13.705800 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:13.706321 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:13.706758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:13.707459 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:13.707913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:13.708337 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:13.840847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:13.849067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-e25fcce6-1d3f-47b8-ae35-ca37109a23b2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.155054 Oct 14 03:24:13.849670 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 609/1183] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:13 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:14.873294 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:14.874018 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:14.880099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:14.880577 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:14.881007 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:14.881689 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:14.882179 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:14.882592 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:15.011531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:15.019404 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-c9711773-0059-487e-8bc0-ec64b0bff5e3 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.150794 Oct 14 03:24:15.019962 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 575/1184] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:14 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:16.042581 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:16.043202 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:16.045035 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:24:16.050740 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:16.055264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:16.055264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:16.055264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:16.055264 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:16.056161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:16.184839 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:16.193047 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-92d75065-0efb-4b32-a53f-6e3269f460d8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.154356 Oct 14 03:24:16.193610 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 610/1185] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:16 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:17.215389 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:17.241462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:17.241462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=4 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:24:17.241462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:17.241462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:17.241462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:17.242099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:17.242099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:17.242099 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:17.354181 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:17.362589 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-8d518096-5d99-4efa-b37d-4ae2bceed401 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.151202 Oct 14 03:24:17.363165 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 576/1186] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:17 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:18.386117 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:18.386756 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:18.388983 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=10 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:24:18.394498 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:18.398026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:18.398026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:18.398026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:18.398026 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:18.398445 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:18.527384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:18.535242 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a33db8a8-6edb-426f-bc19-2a4a3c555f3c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.152979 Oct 14 03:24:18.535805 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 611/1187] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:18 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:19.557621 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:19.558254 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:19.564609 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:19.565078 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:19.565504 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:19.566204 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:19.566648 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:19.567061 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:19.691724 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:19.699395 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a8da76f8-4b6e-461b-958a-c980f363aa81 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.145643 Oct 14 03:24:19.699951 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 577/1188] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:19 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:20.723253 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:20.723790 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:20.730221 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:20.730697 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:20.731172 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:20.731926 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:20.732373 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:20.732786 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:20.860941 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:20.869282 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b19f71b0-b1e1-4618-bd6b-de479023cefa tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.150546 Oct 14 03:24:20.869880 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 612/1189] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:20 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:21.891150 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:21.895250 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:21.898654 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:21.899132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:21.899573 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:21.900264 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:21.900719 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:21.901142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:22.034742 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:22.042555 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9f5afdb5-0e24-4b70-a5dc-4b9356ffcb5c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.155433 Oct 14 03:24:22.043128 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 578/1190] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:21 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:23.065214 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:23.065864 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:23.072478 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:23.072957 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:23.073387 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:23.074118 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:23.074564 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:23.074985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:23.203014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:23.210588 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-23276440-5bb7-4f28-951b-d329bfaf85f4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.149303 Oct 14 03:24:23.211153 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 613/1191] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:23 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:23.864297 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-b540f910-0de9-42fe-a0c7-495517792f55 req-fc3ba0b5-5f7c-4366-8312-94ff704accc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546", "name": "network-vif-plugged", "status": "completed", "tag": "fb866d3c-4aaa-4710-8d9d-2b3351143b4a"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:24:23.874017 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-b540f910-0de9-42fe-a0c7-495517792f55 req-fc3ba0b5-5f7c-4366-8312-94ff704accc4 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:23.874500 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-b540f910-0de9-42fe-a0c7-495517792f55 req-fc3ba0b5-5f7c-4366-8312-94ff704accc4 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:23.874954 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-b540f910-0de9-42fe-a0c7-495517792f55 req-fc3ba0b5-5f7c-4366-8312-94ff704accc4 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:23.886624 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-b540f910-0de9-42fe-a0c7-495517792f55 req-fc3ba0b5-5f7c-4366-8312-94ff704accc4 service nova] Creating event network-vif-plugged:fb866d3c-4aaa-4710-8d9d-2b3351143b4a for instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 on hv-cinder-80152 Oct 14 03:24:23.892110 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-b540f910-0de9-42fe-a0c7-495517792f55 req-fc3ba0b5-5f7c-4366-8312-94ff704accc4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124712 Oct 14 03:24:23.894553 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 579/1192] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:24:24.233327 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:24.233994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:24.241231 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:24.241705 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:24.242163 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:24.242915 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:24.243436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:24.243854 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:24.378596 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:24.386177 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7b9d2735-a62d-446c-9c1a-8ec5027a285e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.156677 Oct 14 03:24:24.386732 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 614/1193] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:24 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:25.409816 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:25.410554 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:25.416760 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:25.417268 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:25.417701 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:25.418421 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:25.418875 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:25.419302 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:25.551579 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:25.559415 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-b764f1f1-3a00-4ef6-99a0-718cd059e507 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1265 microversion: 2.1 time: 0.154381 Oct 14 03:24:25.566445 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 580/1194] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:25 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:26.585148 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:26.585784 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:26.592237 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:26.592724 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:26.593161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:26.593883 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:26.594339 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:26.595380 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:26.721621 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:26.729336 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-de8e8739-f9fb-4527-bd3f-d1f456d3ee12 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1451 microversion: 2.1 time: 0.148037 Oct 14 03:24:26.729927 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 615/1195] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:26 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:24:26.752571 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:24:26.753270 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:24:26.759671 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:26.760148 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:26.760580 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:26.761265 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:26.761718 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:26.762167 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:26.893280 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:24:26.900909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d1051e10-0e57-419f-836a-73684947bee4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1451 microversion: 2.1 time: 0.152894 Oct 14 03:24:26.901468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 581/1196] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:24:26 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:24:28.788801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-9fc89452-2f58-4a97-98d9-fdb6c7b3f73d req-affdb232-68db-434a-bff7-2e0d4df88ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546", "tag": "fb866d3c-4aaa-4710-8d9d-2b3351143b4a"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:24:28.798160 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-9fc89452-2f58-4a97-98d9-fdb6c7b3f73d req-affdb232-68db-434a-bff7-2e0d4df88ed5 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:24:28.799154 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-9fc89452-2f58-4a97-98d9-fdb6c7b3f73d req-affdb232-68db-434a-bff7-2e0d4df88ed5 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:24:28.799586 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-9fc89452-2f58-4a97-98d9-fdb6c7b3f73d req-affdb232-68db-434a-bff7-2e0d4df88ed5 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:24:28.810437 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-9fc89452-2f58-4a97-98d9-fdb6c7b3f73d req-affdb232-68db-434a-bff7-2e0d4df88ed5 service nova] Creating event network-changed:fb866d3c-4aaa-4710-8d9d-2b3351143b4a for instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 on hv-cinder-80152 Oct 14 03:24:28.814573 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR oslo.messaging._drivers.impl_rabbit [req-9fc89452-2f58-4a97-98d9-fdb6c7b3f73d req-affdb232-68db-434a-bff7-2e0d4df88ed5 service nova] [24dfe548-e92c-4086-9799-9d514acdd768] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 14 03:24:29.822361 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO oslo.messaging._drivers.impl_rabbit [req-9fc89452-2f58-4a97-98d9-fdb6c7b3f73d req-affdb232-68db-434a-bff7-2e0d4df88ed5 service nova] [24dfe548-e92c-4086-9799-9d514acdd768] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60800. Oct 14 03:24:29.826014 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-9fc89452-2f58-4a97-98d9-fdb6c7b3f73d req-affdb232-68db-434a-bff7-2e0d4df88ed5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.101369 Oct 14 03:24:29.826607 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 616/1197] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:26:04.701373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-165000072", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1438726321", "security_groups": [{"name": "tempest-secgroup-smoke-1014083988"}], "block_device_mapping_v2": [{"uuid": "024fe005-4830-4d60-b460-b4743870622f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "977c90dd-1f4c-40e4-bab8-7e46041a9b05"}]}} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:26:04.712708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:26:04.713356 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:26:04.714709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 03:26:04.714846 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Fri Oct 14 03:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Oct 14 03:26:04.820411 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.network.neutron [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] validate_networks() for [('977c90dd-1f4c-40e4-bab8-7e46041a9b05', None, None, None, None, None)] {{(pid=119283) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 03:26:05.256468 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Flavor limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 03:26:05.256878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Image limits 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 03:26:05.257371 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Flavor pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 03:26:05.257781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Image pref 0:0:0 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 03:26:05.258203 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.virt.hardware [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119283) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 03:26:05.266781 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:05.267285 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:05.267709 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:05.268969 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:05.269406 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:05.269843 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:05.286963 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Getting quotas for project 094ec37b955e4518b7abffd09afef4f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 03:26:05.290878 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.quota [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Getting quotas for user fcc0e4c5bee64180884513f13757140c and project 094ec37b955e4518b7abffd09afef4f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119283) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 03:26:05.351074 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Going to run 1 instances... {{(pid=119283) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 03:26:05.353950 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='024fe005-4830-4d60-b460-b4743870622f',volume_size=None,volume_type=None)] {{(pid=119283) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 03:26:05.730995 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-e5f7e44e-0908-461e-8c5b-bbb9c3196a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.033906 Oct 14 03:26:05.731699 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 582/1198] 10.222.0.39 () {60 vars in 1147 bytes} [Fri Oct 14 03:26:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 03:26:05.742614 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:26:05.743368 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=76 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:26:05.744574 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 14 03:26:05.744716 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Fri Oct 14 03:26:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 (ip 10.222.0.39) !!! Oct 14 03:26:05.754963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7e3c3fec-e966-4182-a9ec-325868716888 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:05.755663 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7e3c3fec-e966-4182-a9ec-325868716888 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:05.813994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7e3c3fec-e966-4182-a9ec-325868716888 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:05.818070 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7e3c3fec-e966-4182-a9ec-325868716888 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1094 microversion: 2.1 time: 0.078372 Oct 14 03:26:05.818632 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 617/1199] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:05 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:06.840800 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:06.841416 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:06.847444 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:06.847918 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:06.848348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:06.849027 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:06.849477 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:06.849926 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:06.912903 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:06.920463 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-1d423923-e388-42f1-8437-a119f2734fdc tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1136 microversion: 2.1 time: 0.084041 Oct 14 03:26:06.921027 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 583/1200] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:06 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:07.944973 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:07.946015 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:07.954731 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:07.955216 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:07.955730 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:07.957079 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:07.957536 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:07.957994 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:08.025395 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:08.033071 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-89c5cdb7-48d7-4237-be02-3f65f42256d1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1210 microversion: 2.1 time: 0.092921 Oct 14 03:26:08.033638 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 618/1201] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:07 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:09.055042 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:09.055652 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:09.062355 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:09.065488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:09.065488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:09.065488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:09.065488 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:09.065943 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:09.202773 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:09.211066 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3f9e4e95-85f1-49c1-8608-16fda57dc9c2 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1278 microversion: 2.1 time: 0.159865 Oct 14 03:26:09.211649 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 584/1202] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:09 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:09.445567 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-998049c3-0c92-4e42-8b8b-460594f898ca req-45965921-61c0-44e8-8c99-c8bb10a5b545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6adee29-5127-4d00-be93-888b37999ee2", "tag": "851a44e1-d1fc-493e-a0b6-607a99356502"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:26:09.458630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-998049c3-0c92-4e42-8b8b-460594f898ca req-45965921-61c0-44e8-8c99-c8bb10a5b545 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:09.458630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-998049c3-0c92-4e42-8b8b-460594f898ca req-45965921-61c0-44e8-8c99-c8bb10a5b545 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:09.458630 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-998049c3-0c92-4e42-8b8b-460594f898ca req-45965921-61c0-44e8-8c99-c8bb10a5b545 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:09.470114 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-998049c3-0c92-4e42-8b8b-460594f898ca req-45965921-61c0-44e8-8c99-c8bb10a5b545 service nova] Creating event network-changed:851a44e1-d1fc-493e-a0b6-607a99356502 for instance b6adee29-5127-4d00-be93-888b37999ee2 on hv-cinder-80152 Oct 14 03:26:09.475279 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-998049c3-0c92-4e42-8b8b-460594f898ca req-45965921-61c0-44e8-8c99-c8bb10a5b545 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033487 Oct 14 03:26:09.475913 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 619/1203] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:26:10.234720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:10.235344 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:10.242570 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:10.243048 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:10.243471 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:10.244185 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:10.244600 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:10.245020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:10.375462 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:10.383234 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-3b90cfc1-c2d9-4d31-a005-3542df00fea6 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.152409 Oct 14 03:26:10.383790 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 585/1204] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:10 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:11.406801 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:11.407504 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:11.413611 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:11.414127 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:11.414570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:11.415260 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:11.415719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:11.416143 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:11.543719 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:11.551978 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-c23eeabb-32f3-420f-b918-1688e3d7379d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.149879 Oct 14 03:26:11.552544 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 620/1205] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:11 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:12.574427 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:12.575020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:12.581467 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:12.581978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:12.582492 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:12.583710 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:12.584152 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:12.584567 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:12.708834 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:12.716429 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-cc2bfb62-fbc4-4721-a1c6-c9dc38e46a51 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.145842 Oct 14 03:26:12.716989 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 586/1206] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:12 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:13.738872 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:13.739509 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:13.746090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:13.746568 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:13.746998 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:13.747690 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:13.748141 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:13.748560 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:13.876984 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:13.885203 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-b8ce45b1-9ff0-4dbd-9147-9ec2a4042a25 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.150173 Oct 14 03:26:13.885745 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 621/1207] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:13 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:14.907620 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:14.908229 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:14.915252 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:14.915730 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:14.916163 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:14.916853 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:14.917304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:14.917726 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:15.054312 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:15.056086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-afcd03e0-71ed-4540-af3a-00501b67ea6e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.152350 Oct 14 03:26:15.056662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 587/1208] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:14 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:16.079092 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:16.079708 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:16.082179 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell0:SELECT=2 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:26:16.086894 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:16.087375 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:16.087812 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:16.088502 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:16.088953 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:16.089372 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:16.220819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:16.228963 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-28bc4c6f-1ac0-4d27-93d3-640b64847e2b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.153744 Oct 14 03:26:16.229522 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 622/1209] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:16 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:17.252167 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:17.252771 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:17.255312 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=2 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:26:17.260075 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell0:SELECT=6 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:26:17.261160 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:17.261635 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:17.262148 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:17.262806 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:17.263249 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:17.263662 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:17.391426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:17.399069 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-9994f7ec-308e-4052-bdc9-e58a45965a1d tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.150812 Oct 14 03:26:17.399630 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 588/1210] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:17 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:18.421879 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:18.422489 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:18.428914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:18.429392 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:18.429848 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:18.430525 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:18.430971 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:18.431384 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:18.565073 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:18.573252 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f783a61c-b822-4c46-9975-423a1053c233 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.155292 Oct 14 03:26:18.573829 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 623/1211] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:18 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:19.596027 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:19.596647 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:19.603652 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:19.604132 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:19.604565 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:19.605255 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:19.605708 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:19.606153 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:19.733281 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:19.741197 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-f8c34236-2694-457f-b5fe-37556cc3e4cb tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.148847 Oct 14 03:26:19.741776 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 589/1212] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:19 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:20.348210 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-f209446d-81c7-4109-8200-2739ae914df2 req-26953773-1028-44ef-9abb-b85fa4d4c391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6adee29-5127-4d00-be93-888b37999ee2", "name": "network-vif-plugged", "status": "completed", "tag": "851a44e1-d1fc-493e-a0b6-607a99356502"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:26:20.358149 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-f209446d-81c7-4109-8200-2739ae914df2 req-26953773-1028-44ef-9abb-b85fa4d4c391 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:20.358626 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-f209446d-81c7-4109-8200-2739ae914df2 req-26953773-1028-44ef-9abb-b85fa4d4c391 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:20.359055 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-f209446d-81c7-4109-8200-2739ae914df2 req-26953773-1028-44ef-9abb-b85fa4d4c391 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:20.370756 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-f209446d-81c7-4109-8200-2739ae914df2 req-26953773-1028-44ef-9abb-b85fa4d4c391 service nova] Creating event network-vif-plugged:851a44e1-d1fc-493e-a0b6-607a99356502 for instance b6adee29-5127-4d00-be93-888b37999ee2 on hv-cinder-80152 Oct 14 03:26:20.375782 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-f209446d-81c7-4109-8200-2739ae914df2 req-26953773-1028-44ef-9abb-b85fa4d4c391 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031279 Oct 14 03:26:20.379802 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 624/1213] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:26:20.829180 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:20.829819 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:20.835850 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:20.836329 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:20.836786 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:20.837536 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:20.838030 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:20.838447 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:20.966912 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:20.974549 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7650dee5-ad77-428d-ac43-2af56e670dfe tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.214571 Oct 14 03:26:20.975113 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 590/1214] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:20 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:21.998792 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:21.999494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:22.005715 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:22.006239 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:22.006672 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:22.007363 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:22.007814 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:22.008234 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:22.142548 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:22.150897 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-7c296570-196c-4960-b128-564503833847 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1266 microversion: 2.1 time: 0.156888 Oct 14 03:26:22.151471 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 625/1215] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:21 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:23.172447 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:23.173057 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:23.179428 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:23.179907 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:23.180339 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:23.181020 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:23.181470 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:23.181935 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:23.307005 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:23.314675 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-4eb029aa-6ef9-4e54-88cd-cecb94ff70a4 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1452 microversion: 2.1 time: 0.146088 Oct 14 03:26:23.315233 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 591/1216] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:23 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:23.336905 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:26:23.337519 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:26:23.343903 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:23.344383 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:23.344819 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:23.345503 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:23.345985 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:23.346408 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:23.703462 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:26:23.711871 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-3a8fc151-89e2-4b07-a97b-d10cb4a79143 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1452 microversion: 2.1 time: 0.378755 Oct 14 03:26:23.712436 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 626/1217] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:26:23 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1452 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:26:25.523295 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-1174904d-40a6-422b-a017-f7b13269696c req-44a763c8-0123-49d1-b61f-bb2cf2c73cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6adee29-5127-4d00-be93-888b37999ee2", "tag": "851a44e1-d1fc-493e-a0b6-607a99356502"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:26:25.533071 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-1174904d-40a6-422b-a017-f7b13269696c req-44a763c8-0123-49d1-b61f-bb2cf2c73cfb service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:26:25.533545 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-1174904d-40a6-422b-a017-f7b13269696c req-44a763c8-0123-49d1-b61f-bb2cf2c73cfb service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:26:25.534006 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-1174904d-40a6-422b-a017-f7b13269696c req-44a763c8-0123-49d1-b61f-bb2cf2c73cfb service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:26:25.544617 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-1174904d-40a6-422b-a017-f7b13269696c req-44a763c8-0123-49d1-b61f-bb2cf2c73cfb service nova] Creating event network-changed:851a44e1-d1fc-493e-a0b6-607a99356502 for instance b6adee29-5127-4d00-be93-888b37999ee2 on hv-cinder-80152 Oct 14 03:26:25.549549 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-1174904d-40a6-422b-a017-f7b13269696c req-44a763c8-0123-49d1-b61f-bb2cf2c73cfb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029959 Oct 14 03:26:25.550166 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 592/1218] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:28:05.088744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:28:05.089481 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG dbcounter [-] [119283] Writing DB stats nova_cell1:SELECT=58 {{(pid=119283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:28:05.090535 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 03:28:05.090680 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Fri Oct 14 03:28:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Oct 14 03:28:05.095893 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-f019d2a6-9159-4e5f-9700-17de81284992 req-a1188fb6-d291-4dda-bee1-891bc159f9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6adee29-5127-4d00-be93-888b37999ee2", "tag": "851a44e1-d1fc-493e-a0b6-607a99356502"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:28:05.098196 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_api:SELECT=22 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:28:05.099010 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG dbcounter [-] [119284] Writing DB stats nova_cell1:SELECT=46 {{(pid=119284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:28:05.100100 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 03:28:05.100235 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Fri Oct 14 03:28:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 (ip 10.222.0.39) !!! Oct 14 03:28:05.105062 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:05.105562 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:05.116843 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:05.117493 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:05.118067 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:05.118872 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:05.119389 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:05.119516 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-f019d2a6-9159-4e5f-9700-17de81284992 req-a1188fb6-d291-4dda-bee1-891bc159f9f5 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:05.119888 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:05.120009 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-f019d2a6-9159-4e5f-9700-17de81284992 req-a1188fb6-d291-4dda-bee1-891bc159f9f5 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:05.120530 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-f019d2a6-9159-4e5f-9700-17de81284992 req-a1188fb6-d291-4dda-bee1-891bc159f9f5 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:05.132221 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-f019d2a6-9159-4e5f-9700-17de81284992 req-a1188fb6-d291-4dda-bee1-891bc159f9f5 service nova] Creating event network-changed:851a44e1-d1fc-493e-a0b6-607a99356502 for instance b6adee29-5127-4d00-be93-888b37999ee2 on hv-cinder-80152 Oct 14 03:28:05.137205 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-f019d2a6-9159-4e5f-9700-17de81284992 req-a1188fb6-d291-4dda-bee1-891bc159f9f5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050412 Oct 14 03:28:05.137976 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 593/1219] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:28:05.153434 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Going to try to terminate instance {{(pid=119284) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:28:05.432483 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-98634b92-9ca7-4706-aaf1-8527c4aef88b tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 204 len: 0 microversion: 2.1 time: 0.348472 Oct 14 03:28:05.434569 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 627/1220] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:28:05 2022] DELETE /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:28:05.444184 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:05.444825 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:05.451826 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:05.452304 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:05.452737 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:05.453437 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:05.453912 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:05.454362 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:05.592343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:28:05.600766 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-d37352d7-a1cb-4294-8db2-d58bc44a36de tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1577 microversion: 2.1 time: 0.161434 Oct 14 03:28:05.601335 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 594/1221] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:05 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:28:06.625570 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:06.626317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:06.633340 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:06.633850 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:06.634289 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:06.634974 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:06.635424 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:06.635843 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:06.763538 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:28:06.771260 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-0c9693f2-7f8b-4e56-86e9-ad50dbdb2917 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1577 microversion: 2.1 time: 0.149935 Oct 14 03:28:06.771833 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 628/1222] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:06 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:28:07.794499 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:07.795119 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:07.801315 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:07.801814 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:07.802245 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:07.802925 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:07.803372 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:07.803788 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:07.864263 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:28:07.872406 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-0c2c2483-88a2-43d3-b323-531792550c84 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1390 microversion: 2.1 time: 0.081900 Oct 14 03:28:07.872975 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 595/1223] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:07 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:28:07.946909 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-683e817f-a91f-4071-9746-2db0bf9260f4 req-d9afa217-7fa9-4318-b287-f5c88ba33173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6adee29-5127-4d00-be93-888b37999ee2", "name": "network-vif-deleted", "tag": "851a44e1-d1fc-493e-a0b6-607a99356502"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:28:07.957308 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-683e817f-a91f-4071-9746-2db0bf9260f4 req-d9afa217-7fa9-4318-b287-f5c88ba33173 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:07.960956 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-683e817f-a91f-4071-9746-2db0bf9260f4 req-d9afa217-7fa9-4318-b287-f5c88ba33173 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:07.960956 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-683e817f-a91f-4071-9746-2db0bf9260f4 req-d9afa217-7fa9-4318-b287-f5c88ba33173 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:07.969532 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-683e817f-a91f-4071-9746-2db0bf9260f4 req-d9afa217-7fa9-4318-b287-f5c88ba33173 service nova] Creating event network-vif-deleted:851a44e1-d1fc-493e-a0b6-607a99356502 for instance b6adee29-5127-4d00-be93-888b37999ee2 on hv-cinder-80152 Oct 14 03:28:07.974847 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-683e817f-a91f-4071-9746-2db0bf9260f4 req-d9afa217-7fa9-4318-b287-f5c88ba33173 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Oct 14 03:28:07.975494 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 629/1224] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:28:08.895352 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:08.897531 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:08.902812 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:08.903291 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:08.903719 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:08.904411 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:08.904859 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:08.905278 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:08.935978 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:08.936448 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:08.936877 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:08.937314 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.objects.instance [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lazy-loading 'fault' on Instance uuid b6adee29-5127-4d00-be93-888b37999ee2 {{(pid=119283) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:28:08.980316 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:28:08.988024 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-7104eaff-939e-4a38-8fcd-5184cc4db92f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 200 len: 1230 microversion: 2.1 time: 0.096569 Oct 14 03:28:08.988591 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 596/1225] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:08 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:28:10.013019 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:10.013752 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: b6adee29-5127-4d00-be93-888b37999ee2] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:10.020378 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:10.021491 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:10.021954 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:10.022635 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:10.023081 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:10.023497 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:10.039136 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] HTTP exception thrown: Instance b6adee29-5127-4d00-be93-888b37999ee2 could not be found. Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Request method failure captured: Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 HTTP/1.1 Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNWqrdXtfACSrxCC5vtCM-C8j-L3b-Fyfw1SNEkokI-z8zwg4ZvDrIa1-bz-e8M9We0RC2U0T5E42gDpRNpnKfrq0WMq9A14Uyqu_0n1mVtvxvNl5lCDnxt8jtZohnrm2gOTWH8wfoWivdyv_F_NG_R24GRTtnnQG60ds4XF6lUXMdM Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:28:10.040763 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_094ec37b955e4518b7abffd09afef4f0"}]}] Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: fcc0e4c5bee64180884513f13757140c Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance b6adee29-5127-4d00-be93-888b37999ee2 could not be found. Oct 14 03:28:10.047362 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': 'b6adee29-5127-4d00-be93-888b37999ee2'} Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6adee29-5127-4d00-be93-888b37999ee2 could not be found. Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:28:10.048241 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6adee29-5127-4d00-be93-888b37999ee2 could not be found. Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6adee29-5127-4d00-be93-888b37999ee2 could not be found. Oct 14 03:28:10.050248 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:10.051755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Returning 404 to user: Instance b6adee29-5127-4d00-be93-888b37999ee2 could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:28:10.051755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-431b8094-a73f-4f66-99b1-afdb6b55980c tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2" status: 404 len: 111 microversion: 2.1 time: 0.034080 Oct 14 03:28:10.051755 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 630/1226] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:10 2022] GET /compute/v2.1/servers/b6adee29-5127-4d00-be93-888b37999ee2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:28:13.600505 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:13.601348 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:13.603041 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [req-79c22be9-bb49-4b2c-8707-879d2c7c5774 req-7e1e6efa-a902-4b5b-b494-73304c961a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546", "tag": "fb866d3c-4aaa-4710-8d9d-2b3351143b4a"}]} {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:28:13.608456 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:13.609007 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:13.609513 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:13.610241 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:13.610688 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:13.611134 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:13.613592 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-79c22be9-bb49-4b2c-8707-879d2c7c5774 req-7e1e6efa-a902-4b5b-b494-73304c961a88 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:13.614425 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-79c22be9-bb49-4b2c-8707-879d2c7c5774 req-7e1e6efa-a902-4b5b-b494-73304c961a88 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:13.615528 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [req-79c22be9-bb49-4b2c-8707-879d2c7c5774 req-7e1e6efa-a902-4b5b-b494-73304c961a88 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:13.627108 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.compute.server_external_events [req-79c22be9-bb49-4b2c-8707-879d2c7c5774 req-7e1e6efa-a902-4b5b-b494-73304c961a88 service nova] Creating event network-changed:fb866d3c-4aaa-4710-8d9d-2b3351143b4a for instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 on hv-cinder-80152 Oct 14 03:28:13.633108 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [req-79c22be9-bb49-4b2c-8707-879d2c7c5774 req-7e1e6efa-a902-4b5b-b494-73304c961a88 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033739 Oct 14 03:28:13.633700 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 631/1227] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:28:13.638383 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Going to try to terminate instance {{(pid=119283) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 03:28:14.013079 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-a40b663e-a4b9-454c-8dbf-d40409d13e78 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 204 len: 0 microversion: 2.1 time: 0.415641 Oct 14 03:28:14.017194 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 597/1228] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:28:13 2022] DELETE /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 03:28:14.023319 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:14.024022 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:14.030299 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:14.032884 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:14.033982 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:14.034701 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:14.035158 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:14.035659 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:14.178791 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:28:14.187285 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-49cd0b8e-4432-484b-8ae7-554cb164faf8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1575 microversion: 2.1 time: 0.168697 Oct 14 03:28:14.187861 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 632/1229] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:14 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 03:28:15.210998 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:15.211727 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:15.218279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:15.218755 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:15.219189 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:15.219874 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:15.220324 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:15.220744 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:15.351529 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.policy [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119283) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:28:15.359434 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-2aaff929-2166-4c5e-8672-bab341642503 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1575 microversion: 2.1 time: 0.152658 Oct 14 03:28:15.360024 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 598/1230] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:15 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:28:16.384850 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:16.385512 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:16.392275 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:16.392758 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:16.393200 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:16.393914 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:16.394370 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:16.394790 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:16.465052 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:28:16.473090 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-f712e503-e521-4289-ab09-764623bb36f8 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1389 microversion: 2.1 time: 0.092788 Oct 14 03:28:16.473947 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 633/1231] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:16 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:28:16.488605 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [req-6b682c0b-100b-419b-874c-ce2640ea2053 req-ba27f5c2-5614-4f4f-b348-e63cf0da56a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546", "name": "network-vif-deleted", "tag": "fb866d3c-4aaa-4710-8d9d-2b3351143b4a"}]} {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 03:28:16.499534 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6b682c0b-100b-419b-874c-ce2640ea2053 req-ba27f5c2-5614-4f4f-b348-e63cf0da56a9 service nova] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:16.500011 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6b682c0b-100b-419b-874c-ce2640ea2053 req-ba27f5c2-5614-4f4f-b348-e63cf0da56a9 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:16.500438 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [req-6b682c0b-100b-419b-874c-ce2640ea2053 req-ba27f5c2-5614-4f4f-b348-e63cf0da56a9 service nova] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:16.512062 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.compute.server_external_events [req-6b682c0b-100b-419b-874c-ce2640ea2053 req-ba27f5c2-5614-4f4f-b348-e63cf0da56a9 service nova] Creating event network-vif-deleted:fb866d3c-4aaa-4710-8d9d-2b3351143b4a for instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 on hv-cinder-80152 Oct 14 03:28:16.517260 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [req-6b682c0b-100b-419b-874c-ce2640ea2053 req-ba27f5c2-5614-4f4f-b348-e63cf0da56a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032367 Oct 14 03:28:16.517909 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 599/1232] 10.222.0.39 () {64 vars in 1317 bytes} [Fri Oct 14 03:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 03:28:17.496429 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:17.496958 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:17.503372 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:17.503848 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:17.504276 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:17.505446 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:17.505931 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:17.506367 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:17.536278 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:17.536747 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:17.537174 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:17.537608 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.objects.instance [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lazy-loading 'fault' on Instance uuid fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 {{(pid=119284) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 03:28:17.577175 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.policy [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc0e4c5bee64180884513f13757140c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094ec37b955e4518b7abffd09afef4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119284) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 03:28:17.585507 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-6c9c956d-f9e2-4383-b309-b6f7ba594578 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 200 len: 1229 microversion: 2.1 time: 0.093019 Oct 14 03:28:17.586096 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 634/1233] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:17 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 03:28:18.609258 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:18.609975 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:18.616373 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:18.616854 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:18.617279 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:18.617985 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:18.618426 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:18.618890 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:18.632086 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] HTTP exception thrown: Instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 could not be found. Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Request method failure captured: Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 HTTP/1.1 Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNWqrdXtfACSrxCC5vtCM-C8j-L3b-Fyfw1SNEkokI-z8zwg4ZvDrIa1-bz-e8M9We0RC2U0T5E42gDpRNpnKfrq0WMq9A14Uyqu_0n1mVtvxvNl5lCDnxt8jtZohnrm2gOTWH8wfoWivdyv_F_NG_R24GRTtnnQG60ds4XF6lUXMdM Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:28:18.633660 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_094ec37b955e4518b7abffd09afef4f0"}]}] Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: fcc0e4c5bee64180884513f13757140c Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 could not be found. Oct 14 03:28:18.635343 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': 'fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546'} Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 could not be found. Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:28:18.636325 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 could not be found. Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 could not be found. Oct 14 03:28:18.638034 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:18.639643 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Returning 404 to user: Instance fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:28:18.639643 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-fcdd8b07-d4ab-46b1-8ed0-92ab157ca77f tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546" status: 404 len: 111 microversion: 2.1 time: 0.030516 Oct 14 03:28:18.639643 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 600/1234] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:18 2022] GET /compute/v2.1/servers/fdeeb3a5-cf86-46ce-a31b-d8fb3c1ba546 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:28:19.130500 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:19.131002 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.compute.api [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119284) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:19.137287 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:19.137783 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:19.138228 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:19.138911 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:19.139361 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:19.139781 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG oslo_concurrency.lockutils [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:19.153317 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.wsgi [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] HTTP exception thrown: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Request method failure captured: Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: request: DELETE /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f HTTP/1.1 Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept: application/json Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Accept-Encoding: identity Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Connection: close Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Length: 0 Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Content-Type: application/json Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Host: 10.222.0.39 Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: Openstack-System-Scope: None Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: User-Agent: python-urllib3/1.26.12 Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Auth-Token: gAAAAABjSNWqrdXtfACSrxCC5vtCM-C8j-L3b-Fyfw1SNEkokI-z8zwg4ZvDrIa1-bz-e8M9We0RC2U0T5E42gDpRNpnKfrq0WMq9A14Uyqu_0n1mVtvxvNl5lCDnxt8jtZohnrm2gOTWH8wfoWivdyv_F_NG_R24GRTtnnQG60ds4XF6lUXMdM Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Id: None Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Domain-Name: None Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Identity-Status: Confirmed Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Is-Admin-Project: True Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Id: default Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Domain-Name: Default Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Project-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Role: member,reader Oct 14 03:28:19.154904 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Roles: member,reader Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_094ec37b955e4518b7abffd09afef4f0"}]}] Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Id: default Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Domain-Name: Default Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Id: fcc0e4c5bee64180884513f13757140c Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: X-User-Name: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: method: > Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: exception: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.156712 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: action_args: {'id': '2499230a-4299-42fb-b9a7-5f67e01e290f'} Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:28:19.157657 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.159101 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.161161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Returning 404 to user: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. {{(pid=119284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:28:19.161161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-a8154177-c134-4065-8080-4a54b58e3cd1 tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 404 len: 111 microversion: 2.1 time: 0.030276 Oct 14 03:28:19.161161 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 635/1235] 10.222.0.39 () {58 vars in 1239 bytes} [Fri Oct 14 03:28:19 2022] DELETE /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:28:19.164693 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '>' {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:19.165298 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.compute.api [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] [instance: 2499230a-4299-42fb-b9a7-5f67e01e290f] Fetching instance by UUID {{(pid=119283) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 03:28:19.171249 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:19.171716 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:19.172142 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:19.172837 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Acquiring lock "4dccde63-09d3-408b-8840-86bc0620ec2d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 03:28:19.173272 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 03:28:19.173687 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG oslo_concurrency.lockutils [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Lock "4dccde63-09d3-408b-8840-86bc0620ec2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 03:28:19.186551 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.wsgi [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] HTTP exception thrown: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Request method failure captured: Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: request: GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f HTTP/1.1 Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept: application/json Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Accept-Encoding: identity Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Connection: close Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Length: 0 Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Content-Type: application/json Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Host: 10.222.0.39 Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: Openstack-System-Scope: None Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: User-Agent: python-urllib3/1.26.12 Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Auth-Token: gAAAAABjSNWqrdXtfACSrxCC5vtCM-C8j-L3b-Fyfw1SNEkokI-z8zwg4ZvDrIa1-bz-e8M9We0RC2U0T5E42gDpRNpnKfrq0WMq9A14Uyqu_0n1mVtvxvNl5lCDnxt8jtZohnrm2gOTWH8wfoWivdyv_F_NG_R24GRTtnnQG60ds4XF6lUXMdM Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Id: None Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Domain-Name: None Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Identity-Status: Confirmed Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Is-Admin-Project: True Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Id: default Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Domain-Name: Default Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Project-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Role: member,reader Oct 14 03:28:19.188026 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Roles: member,reader Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094ec37b955e4518b7abffd09afef4f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_094ec37b955e4518b7abffd09afef4f0"}]}] Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Id: 094ec37b955e4518b7abffd09afef4f0 Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312620246 Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Id: default Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Domain-Name: Default Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Id: fcc0e4c5bee64180884513f13757140c Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: X-User-Name: tempest-TestVolumeBootPattern-1312620246-project Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: method: > Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: exception: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.189829 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: action_args: {'id': '2499230a-4299-42fb-b9a7-5f67e01e290f'} Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: {{(pid=119283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 03:28:19.190987 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. Oct 14 03:28:19.193214 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: ERROR nova.api.openstack.wsgi Oct 14 03:28:19.194720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: DEBUG nova.api.openstack.wsgi [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Returning 404 to user: Instance 2499230a-4299-42fb-b9a7-5f67e01e290f could not be found. {{(pid=119283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 03:28:19.194720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: INFO nova.api.openstack.requestlog [None req-88334a9d-88d3-4049-999a-a2a803eaf97e tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f" status: 404 len: 111 microversion: 2.1 time: 0.028490 Oct 14 03:28:19.194720 dv-cinder-801522-13-iscsi devstack@n-api.service[119283]: [pid: 119283|app: 0|req: 601/1236] 10.222.0.39 () {58 vars in 1236 bytes} [Fri Oct 14 03:28:19 2022] GET /compute/v2.1/servers/2499230a-4299-42fb-b9a7-5f67e01e290f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 03:28:20.632124 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: DEBUG nova.api.openstack.wsgi [None req-ae329df9-b333-46ac-bd06-7e60fd37a6af tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] Calling method '.version_select at 0x7f2beba1a820>' {{(pid=119284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 03:28:20.735545 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: INFO nova.api.openstack.requestlog [None req-ae329df9-b333-46ac-bd06-7e60fd37a6af tempest-TestVolumeBootPattern-1312620246 tempest-TestVolumeBootPattern-1312620246-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1438726321" status: 202 len: 0 microversion: 2.1 time: 0.107698 Oct 14 03:28:20.736121 dv-cinder-801522-13-iscsi devstack@n-api.service[119284]: [pid: 119284|app: 0|req: 636/1237] 10.222.0.39 () {58 vars in 1263 bytes} [Fri Oct 14 03:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1438726321 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)